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FOREWORD 



Assessment of work -relevant affect is a continuing priority in vocational education. Knowledge 
and understanding of the ways in which workers approach their jobs, their co-workers, and the entire 
work environment is vital for providing relevant and effective job preparation. These non-technical 
variables help to determine those aspects of the work-a-day world which are viewed negatively and 
those which are reasonably rewarding and contribute to the worker's satisfaction and success on the 
job. 

This study was an exploratory effort in the use of woid association procedures to assess the af* 
fective and descriptive meanings workers associate with their work environments. It was conducted 
as part of a long-range, programmatic research and development program at The Center, the purpose 
of which is to develop systematic guidelines and procedures for the derivation of curriculum content. 
Procedures and guidelines now under development by The Center's "Methods for Curriculum Con - 
tent Derivation" program will aid developers of vocational curriculum and occupational training pro- 
grams to accurately identify occupational requirements and to select curriculum content which most 
warrants formal training consideration.: 

This report of the methods developed for assessing work-relevant affect, and the initial results 
of their exploratory use. should be of particular interest to vocational and career educators striving 
to better provide students with the knowledges and skills to cope with the interpersonal, affective 
dimensions of work. It should also provide curriculum developers and training directors in vocational 
education, business, industry, and government with information about and clues for promising ap- 
proaches to the identification of relevant job content for training. It is especially hoped that the 
report will stimulate interest and dialogue among vocational researchers and developers, and contrib- 
ute to the continuation of investigations of alternative approaches to the assessment of work-relevant 
affect. 

Many people have contributed to the work leading to the development of this report. In par 
ticular. The Center is indebted to the authors, Duane Essex, research associate, and Cheng Liu, for- 
mer research specialist at The Center and currently assistant professor at the State University of New 
York, Buffalo, New York. The Center also expresses its appreciation to the employers and supervisors 
of the several businesses and public agencies in the Columbus metropolitan area for their cooperation 
in the study and to the 29 automotive mechanics, 29 secretaries, and 19 computer data processors who 
participated in the study. 

The Center expresses appreciation to Dr. Robert 8. Frary, Coordinator of Research, College 
of Education at the Virginia Polytechnic Institute and State University for his critical review of the 
manuscript prior to final revision and publication. 

Robert E.Taylor 
Director 

The Center for Vocational Education 
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CHAPTER I 



IMPORTANCE OF AFFECT AND ITS ASSESSMENT IN CAREER EDUCATION 



Affect in Career Education 

There is growing awareness among educators and researchers that the affective dimensions of 
human development must be given more adequate emphasis in career education. Educational pro- 
grams have traditionally concentrated on the development of cc^nitive skills and have not adequate- 
ly emphasized development of the student as a "whole person, ' Increasingly, students are being re 
cognized as having broad spectrums of developmental needs, including both cognitive and affective 
needs (King, 1971; Midjaas, 1970; Woolley, 1970).'' In spite of a lack of general agreement on the 
definition of afff *, affect is viewed as a very important and complex part of human and vocational 
development that must be understood if career education is to be effective education. 

There are two especially important reasons for increasing educational emphasis on the total 
person. First, there is the recognition that affect and cognition are closely related in the classroom. 
Some experts even argue that affect and cognition are practically inseparable. As a result, educators 
now advocate a broader set of educational objectives. Second, job performance has often been found 
to be a function of certain affective skills and attributes, such as ability to work in close cooperation 
with others and attitude toward the work performed. 

Consequently, research efforts have become increasingly concerned with identifying those work- 
related affective skills and attributes that are developed in the educational process, especially those 
that are related to job success; but clear, tellable identification has not yet been attained. Thus, it is 
imperative that such clear identification be accomplished first in order to provide career educators 
with initial affective goals. 



It i$ also possible to distinguish the psychomotor, or behavioral aspect of davelopment from the affective 
and cognitive dimensions (Krathwohl, Bloom & Masia, 1964). Research has indicated that behavior is an important 
variable in the development of cognition and affect. For example, Brcer and Locke (1965) have shown, in a series 
of studies, that successful performance of a task will influence a subject's attitude toward that task as well as facili- 
tate the development of concomitant cognitive skills. However, as Fishbein and Ajzen {1972, p. 523) pointed out 
in a review of the literature, the conditions under which behavioral performance v^ll change beliefs, attitudes, or 
intentions are still unknown. The relationship of the piychomotor aspect of development to cognition and affect 
remains, therefore, an important question and is deserving of further research. However, this question was outtide 
the scope of this study which was concerned with the identification and explication of affect and its dimensions. 
As discussed below, this study included the identification of certain cognitive components but did not attempt to 
identify related psychomotor components. 
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Affect arKi Cognition 



A major reason for growing emphasis on the whole perwn in career education is the av/areness 
that affect is inextricably related to cognition. Although the exact nature of the affect-cognition 
relationship is not clear, considerable data have been accumulated to indicate that affective develop* 
ment in areas such as interests, attitudes, and values is related tc cognitive experience. After sum- 
marizing much of the literature concerning attitude formation, Fishbein and Ajzen (1972) concluded 
that there is widespread agreement that "a person's attitude toward an object is related to his beliefs 
about it" (p. 507). This is true whether the attitude object is a person, an issue, or a behavior. This 
correlation between feeling and belief has been supported by resea^h conducted in the cU.3room 
and on the job. Leonard (1972) investigated the affectivenrognitive consistency of values held by 
college students and reported a moderate degree of relationship between cognitive and affective 
components of their attitude structure. In a study at the high school level. Gable and Roberts(1973» 
found that cognitive and affective variables were correlated and when combined could account for 
32% of variation in student grades. Similarly, tnit in a job-related context, Kazanas and Wolff (1972) 
summarized research concerning development of work habits in vocational education and concluded 
that wccessful vocational students not only demonstrated required psychomotor skills, but also had 
developed effective work habits such as ability to handle directions, wholesome attitude toward work, 
pleasing personal manner, poise, and self -^su ranee. This is an example of what Hartup (1973) point- 
ed out as mounting evidence that academic competence may not be a sufficient condition for en- 
hancement of the student's school success. Finally, at the eJementary school levei, Kifer (1973) 
found academic performance to be related to the development of affective tiaits and pointed out 
the complex interactions between demands for academic achievement in school and the personal 
development of the learner. Much of this evidence strongly implies that affective behaviors develop 
when appropriate learning experiences are provided much the same as cognitive behaviors develop 
from appropriate learning experiences (Krathwohl, Bloom & Masia, 1964). 

Educators hwe reacted to this growing body of literature by attempting to formulate a new, 
broader range of educational objectives. They have introduced wholistic corxrepts such as "confluent 
education," representing the integration of affective and cognitive elements (Brown, 1971), and 
"life career development," which inci^jdes such career guidance goals as (a) self-knowledge and 
interpersonal skills, (b; career plannini, > nowledge and skills, and (c) knowledge of the work and 
leisure worlds (Bingham, 1972). These concepts focus on the need to establish comprehensive edu- 
cational goals that will help develop both cognitive and affective attributes and skills. 



Affect and Job Performance 

A second major reason for the increasing focus on the educational development of the whole 
person is that job satisfaction, general adjustment skills, and attitudes toward work have been recog- 
nized as major factors in successful job performance. In a review and synthesis of the literature on 
occupational adaptability Sjogren (1971) noted that the adaptability of the worker to a new situa- 
tion is related to many factors in the work environment other than the ability requirements of tiic 
work. These include job satisfaction and attitude regarding such variables as (a) content of the work, 
actual tasks performed, and control of work, (b) direct supervision, (c) the employing organization 
and its management, (d) opportunities for advancement, (e) pay and other financial benefits, (f) co- 
workers, and (g) working conditions. In a survey of 642 workers selected from multiple occupations. 
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Garbin, Salomone, Jackson, and Ballweg (1970) reported that while 46,7% of the sample identified 
technological skill as the most difficult thing they had to learn, they also listed interpersonal (19.2%), 
personal (14.8%) and organizational (4.3%) factors as adjustment obstacles. Kazanas and Wolff 
(1972) bluntly pointed out that if the worker cannot adjust to the non-technical requirements of 
the job he is likely to be dismissed. 

It is not clear to what extent successful work attitudes and general adjustment skills are a func- 
tion of the worker's past learning history and to what extent they are a function of the work en- 
vironment itself. But it is clear that successful job performance depends upon what has been termed 
a correspondence between the individual and the environment (Dawis, LofquistSi Weiss, 1968) and, 
just as clearly, that both affective and cognitive variables are involved in that correspondence. 

Reflecting this concern, research organizations have begun to explicate affectively-baseH work 
problems to which the educator should address himself. The Career Education Developmer.c Task 
Force of the National Institute of Education (1973) hypothesized that the lack of general skills and 
attitudes was a major work entry problem and identified important research issues such as: 

Present youth attitudes toward work, by socioeconomic, rural-urban, regional, and 
racial or ethnic groupings, the conditions under which they will or will not work; 
th? extent of their desire to work; what they find to be relevant in work-related 
education (p. 67). 

The sorts of characteristics that employers appreciate in employees; this has become 
important within the last several decades because of economic shifts from manufac- 
turing and agricultural to public, non-prof it servic: e.Tiployment, (p. 63). 

These concerns emphasize the need to identify and develop those work-relevant attitude and adjust- 
ment skills that facilitate the worker's initial job performance. In addition, the report by the Special 
Task Force to the Secretary of Health, Education, and Welfare (Work in America, 1972) indicates 
that educators must become aware of existing on-the-job attitudes beceiuse discontented workers are 
a substantial problem in the work environment. 



Need to Measure Affect 

Broad conceptualizations such as "confluent education" and interpersonal adjustment repre- 
sent initial reactions to the evidence that affective development is concomitant with technical in- 
struction in the classroom and that there are certain affective, adaptive mechanisms which f^ilitate 
job entry and success. But, little empirical evidence is available to identify the particular affective 
changes that occur in the classroom. Furthermore, little hard data are available concerning those 
affective attributes and skills that are actually used by workers in the course of successful job per- 
formance. 

There are, however, some research findings that begin to outline the more general affective 
factors involved in both school and job adjustment. For example, Pucel (1972) reported that student 
interest and personality were related to the successful training of post-secondary vocational and tech- 
nical education students. Walther (1970) reported the factor analysis of a self-report inventory that 
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was constructed to measure work-relevant attitudes. Optimism, unsocialized attitudes, and self-con- 
fidence emerged as three important work-relevant attitudes. Rosen (1972) reported the reinforcer 
characteristics of 67 occupations, based on the responses from over 2000 workers, and predicted 
job success on the basis of the degree to which the individual's work personality matched the work 
environment. Work personality included such affective dimensions as a worker's feeling about re- 
cognition, authority, autonomy, co-workers, and responsibility. 

However, more specific and systematic data are needed. Affective objectives require clear goals 
which in turn require detailed information concerning work-related affective components. Without 
clear-cut behavioral objectives, educational goals are often discarded {Wight, 1971). Thus, an instru- 
ment sensitive to multiple components of affect is needed, one which will CKJtline the spectrum of 
affect that an individual assigns to the environment: an instrument that will indicate the affective 
meaning of the environment. 



Affective Measurement 

The lack of appropriate measurement techniques to assess the range of a^ective meaning assign- 
ed to the work environment has been a barrier to a concise delineation of the affective skills needed 
by workers. One reason for this is the complexity of the affective domain, and its intrinsic relation 
to the cognitive domain. The ties between the two domains make it difficult and, perhaps, inadvis- 
able to measure components of affect only, as existing instruments usually do. An appropriate mea- 
sure should reveal the pattern of affectivity and the relationship of that pattern to the cognitive do- 
main. A second reason for the above mentioned barrier is the lack of agreement at present on what 
in the affective domain should be assessed. A third reason is that, because affective development has 
traditionally been considered outside the scope of school-based education, there has been little im- 
petus to assess affective changes that are related to classroom instruction. While this dated view is 
changing, there remains the problem of ensuring that relevant dimensions of affect are developed 
and assessed in the classroom and at work. Each of these three reasons for the lack of an appropriate 
technique or procedure to assess affect is discussed below. 



Complexity of Affect 

While some definitions of affect have been limited to "a general evaluation or feeling of favor- 
ableness toward the object in question" (Fishbein & Ajzen, 1972, p. 493), a more global, multifaceted 
definition is generally attempted. For example, Roberts (1972) stated that affective education at- 
tempts to educate the emotions and listed personal awareness, creative behavior, interpersonal aware- 
ness, subject orientation, and affective styles of learning as some important categories to consider 
when planning affective experiences in the classroom. This latter approach is an attempt to exhaus- 
tively outline the affective domain. Perhaps the most comprehensive and concise example of this 
approach is Krathwohl, Bloom, and Masia's (1964) attempt to derive a taxonomy of affective edu- 
cational objectives. They included five categories of affect and gave examples of educational objec- 
tives and test items which illustrate each category. These categories and their subdivisions are: 

1.0 Receiving 

1.1 Awareness 

1.2 Willingness to receive 

1.3 Controlled or selected attention 



4 

15 



2.0 Responding 

2.1 Acquiescence in responding 

2.2 Willingness to respond 

2.3 Satisfaction in response 

3.0 Valuing 

3.1 Acceptance of a value 

3.2 Preference for a value 

3.3 Commitment (conviction) 

4.0 Organization 

4.1 Conceptualization of a value 

4.2 Organization of a value system 

5.0 Characterization by a value or value complex 

5.1 Generalized set 

5.2 Characterization 

These categories approximate a continuum of affect under the organizing principle of internalization. 
Krathwohl et al. (1964) defined internalization as a "process through which there is at first an in- 
complete and tentative adoption of only overt manifestations of the desired behavior and later a 
more complete adoption" (p. 29). 

Krathwohl et al. (1964) emphasized the fundamental unity of the person and noted that their 
attempt to delineate the affective area separately from the cognitive was not intended to suggest 
that there was a fundamental separation; "There is none" (p. 45). They listed examples of cognitive 
overlap with each category of affect and noted that educational goals in one domain can be viewed 
as a means to the attainment of a goal or objective in the other. "In some instances we use changes 
in the cognitive domain as a means to make changes in the affective; e.g., we give the student infor- 
mation intended to change his attitude. In other instances we use an affective goal as a means to 
achieve a cognitive one; e.g., we develop an interest in material so the student will learn to use it" 
(Krathwohl et al., 1964, p. 54), Focusing on the environment, Wight (1972) further pointed out 
the complexity of affect by indicating the multiple objects of affect found in education; self, others, 
society, learning, work, leisure time, aesthetics, the natural world, and life. Ir addition, Wight noted 
that affect is present with cognitive and psychomotor activity. 

Thus, it can be argued that any method purporting to measure affect must be addressed to a 
multifaceted domain. However, present methods are often based on a unitary conception of affect 
such as the positive or negative evaluation (usually termed attitude) associated with some psycholog- 
ical object (e.g., Fishbein & Ajzen, 1972; Murray, 1971; Edwards, 1957). Although the semantic 
differential technique (Osgood, Suci, & Tannenbaum, 1957; Osgood, 1969) was devised to measure 
multiple dimensions of affect, it has generally revealed only the primary factor of evaluation and 
the secondary factors of potency and activity. Neither the methods based on a unitary conception 
of affect, nor the semantic differential technique, attempt to relate subjects' responses to the cog- 
nitive domain. 
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Affective Skills and Career Goals 



A second reason for the lack of methodology and instrumentation to measure affect is that 
there is little agreement on what should be assessed: there is little agreement on what affective skills 
a worker actually needs to facilitate his interaction with the work environment. As Brandes (1973) 
pointed out, lack of agreement on educational goals has always been problematic in traditional sub- 
ject areas, but is much more problematic in establishing goals relative to such affective components 
as interests, attitudes, and values. For exampie, when the teacher wishes to prepare students to ef- 
fectively make the interpersonal, personal, and organizational adjustments to work that Garbin et al. 
(1970) reported as normal work entry problems by what criteria can the teacher decide between 
(a) development of self-knowledge and interpersonal skills, as part of Brown's (1971) concept of 
life career development, or (b) development of optimism, socialized attitudes, and self-confidence, 
the three important work-relevant attitudes empirically derived by Walther (1970)? Although it 
could be argued that both concerns should be a focus for the teacher, it is clear that job-related af- 
fective skills need sharp empirical definition before agreed-upon affective objectives are established. 
Consequently, an instrument is needed which will clearly define and assess the affect associated with 
career development needs. 



Affect Measurement and Ethics 

A third important reason for the lack of techniques and instrumentation designed to measure 
theaffectiva domain was given by Tyler (1973); 

There are two main principles that should be carefully considered in reviewing 
proposed objectives in the affective domain. One is the political principle that 
the function of the school in a democratic society is to help the student gain 
the means for increasing independence in judgments and action, and not to in- 
doctrinate particular political or sectarian views. The other is the ethical prin- 
ciple that each individual has a right to privacy not to be invaded by the school 
(p. 3) 

Tyler noted that the school must be prepared to justify every major objective in terms of values 
widely accepted by the lay public or expressly stated in the constitution and statutes, and he cited 
the National Assessment Project report (e.g., "ethical and dependable in work, school, and social 
situations," Tyler, 1973, p. 6), as an example of socially approved affective goals. An example of 
this position is represented by the Utah State Board of Education (1971) which adopted only those 
affective objectives that had social justification. The board issued a prospectus which identified 
basic social values, behaviors, and understandings and developed two purposes: (a) to guarantee the 
relevancy of programs for each student, and (b) to provide a usable pattern for an organization by 
which each teacher can assist students in building better citizenship. 

It is clear that ethical considerations should continue to yuide instrument development. There- 
fore, it is necessary that assessment of affect be focused on those skills that prepare the student to 
successfully cope with the work environment and increase the independence and "freedom of the 
individual to make his own choices, to develop his own belief system, and to experience and express 
his own feelings" (Tyler, 1973, p. 4). 
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Careful selection of educational objectives, cognitive or affective, should be followed by ftjrther 
research. For example, Krathwohl et al. (1964) pointed out that research should continue and 
should be directed toward understanding the underlying process by which individuals undergo change 
in the affective domain, and towafJ continued questioning, by philosophers as well as behavioral sci- 
entists, as to what changes are desirable and appropriate. Further, Krathwohl et al. ( 1964) noted 
that "if we obscure the objectives in the affective domain and bury them in platitudes, how can we 
examine them, determine their meaning, or do anything constructive about them" (p. 91 )? 

Thus, the complexity of affect and the need to account for its relation to cognition, the lack 
of agreement on what are work-relevant affective skills, and ethical concerns over the violation of 
civil rights have all combined to inhibit development of much needed methods to accurately measure 
the dimensions of affective and cognitive meaning that workers assign to the work environment. 
What is needed is a set of systematic techniques and methods that will identify and assess (a) the 
multiple dimensions of work-related affect and their relation to the concomitant cognitive meanings 
of the work environment, (b) those affective dimensions relevant to career success, and (c) affective 
dimensions which facilitate self-development. The development of a viable methodology to meet 
these goals was the focus of the present investigation. 

Word Association and Assessment of Affect 

Self-report procedures are probably the most widely used and most successful methods of de- 
termining the nature of affect associated with the work environment (Tyler, 1973), and workers 
who are satisfactorily performing their jobs are probably the best source of information. Given the 
broad methodological goals of this investigation, the word association paradigm seemed a most appro- 
priate method of self-report. Past research has indicated that word associations represent a broad 
semantic range of both affective expressions toward and cognitive descriptions of a stimulus. More- 
over, research findings indicate that the specific associative response domain (e.g., the work-related 
associative domain) from which responses are elicited can be partially determined by the instructions 
given to subjects in a word association task. Also, various dimensional analyses of word association 
responses have been used to define and map the interrelationships between multiple semantic com- 
ponents. These various issues are discussed below and it was propo*^ed that the present investigation 
use word association procedures to identify the multiple components of affect which workers asso- 
ciated with their work environment. 



Affect and Cognition in Associative Responses 

Associative techniques, in which the subject must respond to a stimulus by giving the first word, 
image, or thought that occurs to him, have been used successfully in explicating both affective and 
cognitive mental processes. As early as the end of the 19th century in Germany, Wundt introduced 
associative techniques into his psychological laboratory in an attempt to explore mental processes. 
Another of the earliest systematic uses of word association to study affective processes was stimu- 
lated by the psychoanalytic movement. Jung (1910) described an associative method in which se- 
lected stimuli, which would elicit responses from underlying "emotional complexes," were presented 
to subjects. This approach to identifying affective dimensions was further developed by Rapaport, 
Gill, and Shafer (1946) to analyze such characteristics as proportion of common or popular 
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responses, reaction times, and associative disturbances in an attempt to detect those emotional con- 
flicts which impaired thought processes. More closely related to the present study, Wyman (1925) 
used a word association technique to appraise interest and attitudes among gifted children, responses 
being scored with reference to "intellectual interest," "social interest," and "activity interest." More 
recently, Terwilliger (1964) used free association responses to predict affect. Pollio (1963) argued 
that the broad psychological meaning of a stimulus word is a function of its conditional or affective 
meaning and that associations will, in part, reflect that meaning. 

The predominant use of associative techniques has been to reveal the more cognitive aspects of 
stimuli in which associations are viewed as objective or denotative descriptions and affective respons- 
es usually comprise a small proportion of the total responses (e.g., Nunnally & Hodges, 1965; Laffel 
& Feldman, 1962). Research in the cognitive domain has indicated that a wide range of descriptive 
associations are elicited by most stimuli. 



Restricting the Associative Domain 

Associative techniques have been used to explicate specific psychological domains. Jung (1910) 
and Rapaport, Gill, and Shafer (1946) selected stimuli that had relevance to the psychoanalytic frame- 
work and elicited responses appropriate to the psychosexual development of the subject. In addition 
to the stimuli used, instructions given to subjects have been successful in modifying associative re- 
sponses. For example, Norton, Marlowe, and Crowne (1963) found that instructions to subjects to 
give words that "most people would give" increased the number of responses when compared to the 
performance of subjects under conditions of standard instructions. 



Analysis of Word Associations 



It has been suggested that associations derive in whole or in part from structures or categories 
of mental processes (Deese, 1962). It is usually true that associations exist in well-organized and, 
in some instances, tightly organized networks. This has been true in studies of free recall data 
(Deese, 1960), associative clustering (Jenkins & Russell, 1952), and category clustering (Bousefield, 
1957). Indeed, dimensional analysis techniques such as hierarchical cluster analysis (Henley, 1969) 
or factor analysis of matrices of associative response overlap measures (Rotberg, 1968) have outlined 
nnultiple semantic dimensions of particular association networks. Such studies provide support for 
the conceptualization of multiple systems or substructures within the associative domain and sug- 
gest that such structures can be identified. 

Use of the word association paradigm seemed germane to the present research goals. The use 
of appropriate stimuli and instructions should elicit a wide range of associations from workers con- 
cerning the affective and cognitive meaning of the work environment, and dimensional analysis 
should reveal the pattern of relationships between affective and other cognitive components. Accom- 
p^'^ment of these goals would provide educators, curriculum developers, and researchers in education 
with a methodology to identify the interests, attitudes, and values that are associated with success in 
career education programs and on the job. 
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Focus of Present Investigation 



The present study was primarily an exploratory effort to develop procedures and techniques 
to assess work-relevant affect. It was not -m attempt to systematically apply those methods to iden- 
tify and measure the spectrum of affective meanings and skills needed by the worker to ensure job 
success. More specifically, this effort was confined to questions and hypotheses concerning the ef- 
ficacy of cenain word association procedures to reveal the patterns of affect and cognition that 
workers assign to their environment. The present study was, therefore, limited in the sense that it 
would not complete the bridge needed between awareness of the importance of affect in career edu- 
cation and the establishment of clear affective objectives in the classroom. In the final analysis the 
concerned educator or curriculum developer must place this information in a coherent theoretical 
framework which accounts for the positive or negative affect that emerges from person-environment 
interaction. It is only then that they can begin to formulate the learning experiences necessary to 
achieve important affective objectives m the classroom. 
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CHAPTER II 



STIMULUS WORD LIST DEVELOPMENT 



It was essential to this investigation that the list oT stimulus words presented to workers be re- 
presentative of a comprehensive list of factors or categories within the work environment. This 
chapter reports the guidelines used and the development of such a stimulus word list. The stimulus 
word list subsequently was used in the conduct of two related studies. 



Selection Criteria 

The first criterion for including a word in the stimulus word list was that it be work related in 
its nneaning. To select appropriate stimulus words for the studies, work was defined as an activity 
in which people usually engage for pay, that is central to personal development and total life adjust- 
ment, and that is a situation for satisfying needs (Lofquist& Dawis, 1969, p. 11). 

A second criterion was that stimulus words be in the noun form wherever possible. Verb and 
adjective forms were used to supplement nouns when they more clearly communicated a work- 
related meaning. There were two reasons for emphasizing the noun form in stimulus word selection. 
First, the noun form was felt to provide the clearest labeling of entities within the work environment 
and to be less ambiguous to subjects. Second, nouns elicit primarily paradigmatic associations, asso- 
ciations in which the stimulus and response fit a common grammatical paradigm (Cramer, 1968, pp. 
68-71; Deese, 1962, pp. 103-105). This grammatical homogeneity removes some cjmbiguity of 
meaning attached to responses. 

A third criterion was that each stimulus word be representative of an empirically-based work 
factor or work category related to job attitudes. 

Work Categories 

In a review and summary of some 150 studies, Herzberg, Mausner, Peterson, and Capwell (1957, 
pp. 31-42) identified the following ten major on-the-job categories (listed in order of the number of 
times each was mentioned in the reviewed studies): 

Intrinsic Aspects of Job : Including all of the many aspects of the work itself, aspects 
which would tend to be constant for this work regardless of where the job was performed. 

Supervision : Including relationships of the worker with his immediate supervisors. 

Working Conditions : Including physical aspects of the environment. 
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Compensation : All sources of reward ether than interpersonal, including the following 
subcategories: Pay , consisting of wages and any other financial return for hours worked; 
and Benefits , consisting of monetary and other objective rewards not directly associated 
with the wage earned. 

Promotion : Including sources of betterment of economic position, organizational stature, 
or professional standing. 

Security : Including prospects of continuous employment and adequate income. 

Company and Management : Including aspects of the worker's immediate situation 
which are a function of organizational administration. 

Social Aspects of Job : Including relationships of worker with other employees. 

Communication : Including aspects of the job situation involving the spreading of 
information in any direction within the organization. 

Benefits : Including policies that prepare the worker for emergencies, illness, old age, and 
hospitalization, holidays, leave, and vacation. 

This list of work categories was felt to be largely representative of categories reported by nu- 
merous subsequent investigations (Roach, 1958^; Vroom, 1964; Scott, 1967; Robinson, Athansiou, 
& Head, 1969). However, ilie Communication category did not prove to be hi'jhly replicable (Peay 
& Wernander, 1969). Further, Roach (1958) and Beer (1964) both reported evidence of a factor 
they called "basic need satisfaction" that appeared to overlap the Herzberg et al. (1957) "intrinsic 
aspect of the job" factor, and to incorporate their "social aspects of job" and "security" factors. 
Roach (1958) also reported several work factors, including those factors labeled "co-workers," "job- 
security," "freedom from work rules," "pride m company," and "development and advancement." 
These factors were, in essence, reported by Beer (1964) under a different descriptive framework. 
Specifically, Beer (1964) investigated the relationships among four leadership climates, motivation, 
perceived opportunity, and actual satisfaction of a hierarchy of needs as described by Maslow (1954). 
This hierarchy of basic needs includes:. 

Security: The desire tor a predictable, structured, and reliable environment. 
The desire for "fairness" and a familiar non-threatening environment. 

Social : The desire for belonging. The desire for association, for acceptance 
by one's fellows, for giving and receiving friendship and love. 

Esteem : The desire for leputation or prestige (defining it as respect or esteem 
from other people), status, dominance, recognition, attention, importance, or 
aopreciation. A desire for esteem from others. 



Since the preparation of this report Roach and Davis (1973) have essentially replicated Roach's 1958 study. 
This provides further support for relative m variance of the work categories used to outline the work environment in 
the Roach (1958) report. 
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Autonomy : The desire for independence and freedom. The desire for achievement 
competence, mastery, adequacy, and confidence. The desire for self-esteem based 
on one's own opinion of oneself as reflected in the specific aspects just listed. 



Selfactualization : The desire to realize one's own potential. The desire for growth 
and self*development, and the desire to become everything that one is capable of 
becoming. 

A factor analysis of Beer's variables indicated that the Maslow needs emerged on separate factors. 
Beer's results support the Roach (1958) findings that needs can be considered as separate factors 
dnd the Maslow framework provides a concise descriptive underpinning. 

It was decided, therefore, to eliminate Communication as a separate category and to include a 
General Need Satisfaction category with subcategories corresponding to the Security, Social, Esteem , 
Autonomy, and Self-Actualization needs outlined by Maslow. The General Need Satisfaction cate- 
gory therefore incorporated the Herzbe'-g et al. (1957) factors of "social aspects of the job" and 
"security" and, to some extent, their "intrinsic aspects of the job" factor. In addition, examination 
of the remaining aspects of work found within the "intrinsic aspects of job" factor indicated that 
such aspects fit Vroom's (1967, pp. 236-252) description of "job content." Therefore, a Job Content 
category was established, along with the subcategories suggested by Vroom, which replaced the 
Intrinsic Aspects of the Job catego y; 

Job Content: All of the intrinsic aspects of the work itself (but not including those 
aspects identified by Beer, 1964) including the following subcategories: Job Level , 
Specialization and Perceived Complexity of Tasks, Control of Methods Used on Job , 
Control of Work Rate , Skills and Abilities of Workers , Sucf^ e ss and Failure in Per - 
formance of Job , and Task Components of Job . 

Hours of Work was considered to be a separate category from Working Conditions . It seemed 
reasonable that, since a worker spends approximately one third of each day at work, working hours 
could be treated as a separate work factor. A Miscellaneous category was also added, and the "Com- 
pany and Management" factor was broadened to create the category Company and Union . 

From a variety of literature defining and describing the work categories, a sample of words re- 
presentative of each category was identified and edited for inclusion in the initial stimulus word list. 
No attempt was made to equate the number of different words among categories, only to ensure that 
the list was representative of these aspects of work described by the categories. The resulting number 
of stimulus words varied from four words in the Promotion category to 18 words in the Supervision 
category.. The initial stimulus word list consisted of 178 different words distributed among the 14 
worK categories. 

Review 

The stimulus words, listed by category heading, were reviewed by a nine-member panel of ex- 
perts in educational psychology, industrial psychology, counseling psychology, manpower training, 
engineering, and vocational education. AM reviewers were instructed to independently (a) examine 
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the words in the list and line-out those words (or categories) deemed inappropriate, and (b) to add 
any additional words (or categories) that would communicate work-related meaning. Each reviewer 
was further urged to add any general comments about the stimulus word list. 

The revised stimulus word list is presented in Table 1. The revised list includes 21 1 words dis* 
tributed among 10 work categories and a Miscellaneous category. Two new categories of words were 
added as a result of reviewer inputs: 

Attributes of Workers : Included those descriptions of work-related traits appropriate to 
to a wide range of occupations. 

AdjeSTtves : Those adjectives representative of the dimensions of affect ordinarily 
measured by the semantic differential technique (e.g., Osgood, Suci, & Tannenbaum, 
1957).: This included the evaluative (e.g., good bad), potency (e.g., ftrong-weak), 
and acti¥{ty (e.g., active-passive) dimensions. 

While the Adjectives category was not considered a work category per se, it was added to the 
list because it was felt that it could provide a relatively simple match of affect level (as defined by 
the adjective stimulus) with work dimensions (as defined by associative responses). 

The revised stimulus word list was the source of a sample of stimulus words selected for use in 
the first of two studies. Experiment I. Three judges were instructed to read the definition of each 
category of work and to reach 100% agreement on the minimum number of stimulus words within 
each category necessary to be representative of the category. The entire Adjectives category was 
included in the stimulus word list to permit investigation of the notion that associative responses 
to adjectives would directly link affect with appropriate dimensions of the work environment. 
Table 2 presents the stimulus word list selected for use in Experiment I. 
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Table 2 

Work- Related Stimulus Words Used in Experiment I 



t. absenteeism 

2. assignment 

3. bonus 

4. boredom 

5. cleanliness 

6. coffee break 

7., company policy 

8. confidence 

9. contribution 

10. cooperation 

11. co-worker 

12. customer 

13. decision 

14. discipline 

15. dismissal 

16. duties 

17. equipment 

18. experience 

19. failure 

20. fairness 

21. fatigue 

22. freedom 

23. grievance 

24. influence 

25. initiative 

26. intelligence 

27. interference 

28. job knowledge 

29. job title 

30. judgment 

31. layoff 

32. lighting 

33. loyalty 

34. management 

35. morale 

36. negotiation 

37. noise 

39. pay 

40. pay raise 

41. pension 

42. personality 

43. praise 

44. prejudice 

45. pride 

46. production 

47. promotion 

48. recognition 

49. relaxation 

50. repetition 



51. reprimand 

52. reputation 

53. retirement 

54. satisfaction 

55. schedule 

56. security 

57. self-expression 

58. self-fulfillment 

59. self-reliance 

60. seniority 

61. sick pay 

62. skill 

63. specialist 

64. status 

65. success 

66. suggestion 

67. supervision 

68. temperature 

69. tension 

70. training 

71. union 

72. vacation 

73. variety 

74. willingness 

75. working hours 

76. work pace 

77. alert 

78. bad 

79. complex 

80. consistent 

81. dangerous 

82. efficient 

83. fast 

84. flexible 

85. good 

86. hard 

87. industrious 

89. mature 

90. meaningful 

91. meaningless 

92. powerful 

93. responsible 

94. safe 

95. simple 

96. slow 

97. sociable 

98. soft 

99. unsociable 
100. weak 
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CHAPTER III 



EXPERIMENT I 



The use of word association procedures to determine the psychological meaning, especially the 
affective meaning, of objects within the work environment requires that: (a) stimulus words be re- 
presentative of the work environment, (b) responses be representative of the range of psychological 
meaning workers assign to objects in their work environment, (c) above all, responses include those 
of an affective nature, and (d) responses can be used to derive associative maps of stimuli which re- 
veal the dimensionality of the work environment and prov'de a context for content analyses of re- 
sponse distributions. 



Meaning in Word Association 

In a relatively unstructure or free word association task, stimulus words can be expected to 
elicit a wide semantic range of affective and descriptive responses, including syntagmatic and para- 
digmatic responses (Nunnally, Flaugher & Hodges, 1963; Cramer, 1968, pp. 188-190). Syntagmatic 
responses are responses given on the basis of associative contiguity. The fact that we do form asso- 
ciative connections between two psychological processes that occur together in time or in immediate 
succession is well-documented (Deese, 1965, p. 7). Paradigmatic responses are based on conceptual, 
mediated relationships and represent more structural associations, e.g., indication of the stimulus as 
a subordinate entity. For the present investigations of psychological meaning, paradigmatic responses 
were considered to be more desirable than syntagmatic responses, a result which appears to be primar- 
ily a function of the instructions given to respondents. 

Instructions 

The instructions given to subjects in a word association task will influence or restrict the se- 
mantic level of response. For example, Kreitler and Kreitler (1968) reported that, when subjects 
were instructed to give either lexical or symbolic responses to varied stimuli, there was less than 
10% semantic overlap between the two respective groups of responses. Cramer (1968) reported 
that instructions could successfully activate either a particular semantic category or, less restrictively, 
establish broad "response sets" (pp. 91-98). 



Associative Maps 

With regard to interpretation of response distributions, there is evidence that a meaningful stim- 
ulus word dimensional structure can be derived from word association responses. 
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Three investigations (Smith, 1968; Pratzner, 1969; Liu, 1972) have demonstrated the use of worker 
responses to develop meaningful maps of the associative relationships among occupationally specific 
stimulus words. The associative maps subsequently were used to successfully differentiate two inde- 
pendently identified groups of electronic technicians who could and who could not repair a wide 
range of equipment. 



Research Questions 

The word association paradigm was, therefore, considered to be a viable approach to investigate 
the psychological, including the affective, meaning of aspects of the work environment. Within this 
paradigm an investigation was conducted to attempt to answer the following major questions: 

1. In a continued word association format, can smgle stimulus words elicit a wide 
semantic range of responses? 

2. Can instructions be used to place the stimulus words in a work-related context 
and the subjects in an affective response set, resulting in a decrease of contiguous, 
or syntagmatic, responses without seriously restricting the semantic range of para- 
digmatic responses? 

3. Can the overall psychological structure of the work environment be determined 
from a hierarchical dimensional analysis of the stimulus words; and, further, can 
this dimensional structure be used as a contextual guide to interpret the meaning 
of responses to individual stimuli? 



Method 

Subjects 

Subjects were 10 automotive mechanics (all males) and 10 secretaries (all females) employed in 
the metropolitan Cclumbus area. Ages ranged from 20 to 54, and all subjects had been employed 
for one or more years within their occupation. Automotive mechanics were sampled from three 
separate automotive repair garages with sample sizes of 5, 4, and 1, respectively. All secretaries were 
sampled from various divisions of The Center for Vocational Education, The Ohio State University, 
in sample sizes of 3, 3, 2, and 2, respectively. 



Materials 

Single-word format .^ As discussed in Chapter II, 100 stimulus words, 76 nouns and 24 adjec- 
tives, were selected from the total stimulus word list with the restriction that they be representative 
of all work categories and that the entire Adjectives category be included. The 100 stimulus words 



See Appendix A for an example of the single word format data collection instrument. 
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were then placed in a continued-association format by printing each word in a column 15 times on 
a single sheet of 8V2" x 1 1" paper, each repetition followed by a blank line as follows: 



task 

task 

task_ 

task 

etc. 

Ten booklets of 100 pages each (i.e., one page for each of the one hundred stimulus words) were 
then collated, each in a difterent random order. The first page of each booklet contained a com- 
pleted example of the word association task and brief directions to be read aloud by the experimen- 
ter. 

Sentence-stem format .^ The 76 nouns in the single-word format were used to construct sen- 
tence-stems as follows: 

a task is 



a task is 



a task is_ 
a task is 



etc. 



The booklets using the sentence-siem format were assembled in the same manner as the single word 
booklet. Stimuli from the Worker Attributes and Adjectives category were not appropriate for this 
format. 



Procedure 

Data collection . Within each occupation, subjects were randomly assigned, five per group, to 
either the singe-word or the sentence-stem condition, resulting in a 2 x 2 occupation-by-format ma- 
trix; 



4 

Data will not be reported separately here for the sentence-stem and single-word fornnats.. Data analyses re- 
ported m this chapter are based on the associative responses pooled across both for.nats. The reader is referred to 
Appendix A for a discussion of the relative efficiency of the sentence-stenn fornnat, when compared to the single- 
word format. 
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Format 



Occupation 


Single-word 


Sentence-stem 


Secretarial Science 


n=5 


n=5 


Automotive mechanics 


n=5 


n=5 









Figure 1. Research Design for Experiment I 



Subjects were instructed to consider the stimulus words (sentence-stems) in relation to their 
work. In addition, subjects were told to write those responses that best expressed what each stimu- 
lus word (sentence-stem) meant to them and how they felt toward the aspect of the work environ- 
ment the stimulus word (sentence-stem) represented. All subjects were asked to limit their responses 
to single words, but subjects in the sentence-siem condition were allowed to use the words "a" or 
"an" as a preface to their response. Subjects were told to write as many different responses as they 
could in the time allowed for responses to each stimulus word. A tape-recorded, 500 Hz tone sounded 
at 50 second intervals to signal the subject to stop writing, turn the page, and begin writing responses 
to the next stimulus word (sentence-stem). Subjects in the single-word condition were given a short 
rest approximately halfway through the task.; Following completion of the task, all subjects were 
given details of the purpose of the experiment, and the experimenter answered any subsequent 
questions. 

Data analysis . The RCMAT computer program (Mead, 1972) at The Ohio State University was 
used to calculate stimulus word overlap matrices. This program is essentially a modification of the 
Relatedness Coefficient (RC) technique developed by Garskof and Houston (1963). The RC is a 
measure of verbal relatedness between two stimuli,; Mead's computer program permits pooling of 
responses across subjects before calculating stimulus word overlap. The pooled overlap measure 
'considers the frequency of response words, the number of shared response words, and the rank or- 
der of response words. The output of the RCMAT program is a stimulus-by-stimulus RC matrix 
that can be reduced by various dimensional analyses (e.g., factor or cluster analysis). 

As a first analysis, an RC matrix was obtained using data based on the pooled responses of all 
20 subjects, excluding idiosyncratic responses (i.e., responses to each stimulus given by only one 
subject). The analysis included only the 76 stimuli common to both the single-word and the sentence- 
stem format. This matrix was then reduced by the Wherry-Wherry II Hierar;,hical Factor Analysis 
program (Harmon, 1967) available at The Ohio State University, 

Following this, a content analysis was made on the pooled responses given by all subjects to 
the 76 stimuli common across ooth formats. This again included all responses given to each stimulus, 
by two or more subjects (i.e., excluding idiosyncratic responses). 
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Results and Discussion 



Factor Analyses 

Figure 2 summarizes the results of the hierarchical factor analysis. It includes those items that 
loaded 2 .2956 on the General, Secondary, and Primary factors. It was apparent that the hierar- 
chical factor analysis did not reveal a clear dimensional structure. Some factors appeared to be in- 
terpretable while others did not. For example. Primary Factor 4 in Figure 2 appeared to be the 
Compensation category listed in Table 1. Also, the Primary Factors 1 and 3 in Figure 2 appeared to 
combine the Skills and Abilities and the Attributes of Worker categories of Table 1 . However, Sec- 
ondary Factor II and Primary Factors 6 and 7 did not lend themselves to interpretation. Therefore, 
the usefulness of the factor solution to outline the structure of the work environment and to provide 
a context for interpretation of the meaning characteristic of each stimulus word response distribution 
was limited., 



Content Analysis 

A content analysis of the pooled response distributions was undertaken in an attempt to both 
clarify the factor structure and deternnine the affective and psychological meaning assigned to each 
stimulus. The content analysis revealed several reasons for the difficulty in factor structure inter- 
pretation. 

First, a wide range of semantic levels was indeed present within the response distribution for 
each stimulus (see Appendix A for pooled response distributions for all stimuli), and it was apparent- 
ly possible for the responses given to one stimulus-member of a particular factor to be the key for the 
entire factor. That is, all other stimuli within the factor may share responses primarily with the key 
stimulus wed (sentence-stem) and not necessarily share many responses among themselves. For ex- 
ample, examination of the response distributions for Primary Factor 7 stimuli, shown in Table 3, 
indicated that the stimulus word "Schedule" was apparently a key to the factor. Most of the responses 
given to "Schedule" were shared with the other three stimulus words. However, a number of semantic 
ievels of response within the response distributions given to the other three stimulus words were not 
shared. The non-sharing of semantic levels did not influence the factor structure and therefore could 
not be used to facilitate the psychological interpretation of any factor as a dimension of the work 
environment. 

Second, the RC statistic was not sensitive to contextual shifts in meaning. For example. Table 
3 indicates that the word "time" was used in one sense in response to "Schedule" and in another 
sense in response to "Freedom." Yet these different levels of usage were considered equivalent when 
the RC was computed for the two stimulus words. This phenomenon further underscores the diffi- 
culty in assigning a satisfactory psychological meaning to the factor. 

Third, the data suggested that if the responses "work" and "job"-given to over 50% of all 
stimuli and considered artifacts of the work-related set— were removed, a different factor structure 
could have emerged. This is likely since a factor structure is a function of the RC matrix and each 
entry in the matrix is an index of the number and rank order of associative responses shared between 
two stimuli. With over 50% of all stimuli sharing the responses "work" or "job," the factor structure 
was indeed confounded. 
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General 



assignment 

boredom 

cleanliness 

confidence 

contribution 

cooperation 

discipline 

dismissal 

duties 

equipment 

experience 

failure 



fairness 

freedom 

influence 

initiative 

intelligence 

interference 

layoff 

loyalty 

management 

overtime 

pay 

pay rdlsti 



Secondary ! 



dismissal 

failure 

interference 

layoff 

security 



personality 

praise 

pride 

production 

repetition 

reputation 

retirement 

satisfaction 

schedule 

security 

self-expression 



self fulfillment 
self-reliance 
seniority 
sick pay 
skill 

specialist 

success 

supervisor 

training 

variety 

working hours 




Secondary II 



cleanliness 

cooperation 

equipment 

judgment 

lighting 

praise 

relaxation 

self-expression 

praise 




Priiiiary 4 


Prim cry 5 


Primary 1 


Primary 3 


Primary 6 


Primary 7 


bonus 


initiative 


bonus 


experience 


confidence 


fatigue 


overtime 


pride 


experience 


intelligence 


co-worker 


freedom 


pay 


production 


job knowl. 


job knowl. 


decision 


schedule 


pay raise 


recognition 


skill 


job title 


influence 


willingness 


pension 


satisfaction 


training 


seniority 


judgment 




promotion 


self-reliance 




skill 


management 




retirement 






status 


personality 




sick pay 








praise 




vacation 








reprimand 












sick pay 












suggestion 












supervisor 





Figure 2. Hierarchi( al Factors with Variables Loading .2956 or Above, 
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Table 3 

Response Distributions for Primary Factor 7 Stimulus Words 



Schedule 


f 


Freedom 


f 


Fatigue 


f 


Willingness 


f 


time* 


13 


necessary' 


3 


work* 


10 


work* 


5 


work* 


4 


v^ork" 


3 


rest 


5 


helpful* 


4 


list 


3 


good 


3 


boring 


3 


learn 


2 


routine 


2 


time* 


3 


tiredness 


3 


do 


2 


performance" 


2 


great 


2 


sleep 


2 


helping 


2 


rigid 


2 


fun 


2 


busy 


2 


able 


2 


daily 


2 


procedure 


2 


performance* 


2 


use 


2 


job" 


2 


need 


2 


run down 


2 


perform 


2 


timely 


2 






job* 


2 


agreeable 


2 


necessary* 


2 






task 


2 


help 


2 


helpful* 


2 








2 


job" 


2 



* Response words shared by two or more stimulus words. 
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Fourth, the difficulty in factor interpretation was further confounded by the functional ambi- 
guity of some stimulus words (sentence-stems). The ambiguity of these stimuli also prevented con- 
tent analyses from determining clearly what affective and psychological meaning workers associated 
with the work environment. Some stimuli were given various interpretations which indicated that 
they were being perceived in various contexts. These stimuli were not perceived by workers as re- 
presenting only the appropriate work-related category from which they were selected. For example, 
examination of the response distribution for the stimulus word "influence," shown in Table 4, indi- 
cated that it was viewed from a conceptual framework broader than the work environment: as polit- 
ical influence, the result of friendship, and it function of knowledge and ability. Thus, it was not 
clear that affective responses (e.g., "good" and "bad") were indications of the individuals' attitudes 
toward their influence at work, nor was it clear to what extent subjects were responding to "influence" 
in a work-related context. 

Table 4 

Response Distribution for 
Stimulus Word "Influence" 



Influence 


f 


friend 


3 


helpful 


3 


good 


2 


supervisor 


2 


help 


2 


bad 


2 


co-worker 


2 


knowledge 


2 


job 


2 


ability 


2 


performance 


2 



Therefore, the perceived ambiguity of some stimulus words further complicated interpretation of 
the factor structure. Because of this ambiguity, some stimulus words failed to elicit work-related 
responses specific to the category of work that the stimulus word was intended to represent. This 
made difficult the interpretation of some affective responses as indicators of subjects' attitudes to- 
ward a specific aspect of their work environments. 



Summary 

Using the word association paradigm, an attempt was made to determine the hierarchical struc- 
ture of work environment categories and to determine the psychological meaning, especially the af- 
fective meaning, of each of those categories. The investigation did not produce a meaningful 



associative map of the work environment. Several reasons have been advanced as possible contribu- 
tions to this result. 



First, the results suggested that the calculation of a stimulus-by-stimulus RC matrix, and sub- 
sequent factor analytic reduction, may be inappropriate for word association data where multiple 
semantic levels of responses are expected, unless a method is also available tor determining the psy- 
chological equivalence of and differences between response distributions prior to computation of 
the overlap between the distributions Second, given that there were multiple semantic levels within 
response distributions and that the meaning of identical responses may have shifted in the context of 
different stimulus words, the RC measure of relatedness was not an adequate index of these complex 
semantic relationships between stimuli. Third, although the stimuli elicited a wide range of semnatic 
responses, a condition necessary to determine the full psychological meaninq of the stimuli, the re- 
sponses "work" and "job" were interpreted as artifactual. Finally, subjects placed the stimuli in 
multiple contexts. Apparently, many stimuli lacked the specificity to elicit responses relevant to 
the particular aspect of the work environment each was intended to represent. This made interpre- 
tation of a response distribution as representing the meaning of a particular aspect of the work en- 
vironment highly tenuous. The stimuli may have lacked specificity in another sense. It was possible 
that, even in those instances when a content analysis suggested the subjects had responded within the 
context of the work environment, they may not have responded from a personal viewpoint, indicating 
what their work environment meant to them. 



CHAPTER IV 



STIMULUS PHRASE LIST DEVELOPMENT 



The single-word or sentence-stem form of stimuli for the continued word association method 
used in Experiment I was inadequate to investigate the affective and other psychological meanings 
of the work environment. It was concluded that, if continued word association was to be a viable 
method to determine the meaning of the work environment for the worker, a different stimulus 
format would have to be used. 

Such a format must increase the specificity of the stimuli so that responses given by workers 
would be confined to the work environment context. However, increased specificity should not be 
obtained at the expense of reduced semantic levels of response within that context, especially the 
affective level. A viable format would also ensure that stimuli elicit self-referent responses from the 
worker in the context of hjs present work environment. Moreover, it should d'xrease the probability 
that artifactual responses, such as "work" and "job," would be elicited from subjects. 

A review of the literature suggested the transformation of stimuli from single words to phrases. 
Specifically, in a recent study concerning the measurement of the construct "morale," Scott (1967) 
used semantic differential scales to measure the fojjowing work-related phrases:. 

My Opportunities for Growth 

My Job 

My Supervisor 

Top Management 

Company Benefits 

My Fellow Workers 

My Pay 

My Working Conditions 

There were several reaons why this particular phrase format appeared to meet the necessary criteria 
for a viable stimulus form in further, continued word association investigations of meaning. 
Artifactual responses, such as "work" and "job," should be incongruous with this phrase form. 
Also, this form of stimulus should primarily elicit self-referent responses which would emphasize 
the persona! affective meaning of the stimuli.. Finally, worker's associations should be relevant only 
to the work environment and should still contain multiple semantic levels of meaning. 

In support of this latter assertion. Rouse and Verinis (1965) dc»monstrated that compound 
stimuli, when selected to define and provide high transitional probability for producing a desired 
response, would increase the probability of that response. It seemed p'ausible that work-related 
phrases would define and provide high transitional probability for producing responses relevant to 
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only the work environment. In addition, responses that are confined to the stimulus-phrase context 
should still contain multiple semantic levels (i.e., the number of semantic levels should not be sub- 
stantially reduced).; Indeed, Cramer (1968) reported that, in general, a more heterogenous set of 
responses were given to compound multiple-word stimuli than to single word stimuli (pp. 91-98). 
This suggested that phrases may increase the semantic range of responses. 

In brief, this format should delimit the subject's associative response domain to that aspect of 
his job defined by each stimulus phrase. The narrowed response domain should contain various se- 
mantic levels of response, including those representing affective meaning. The concept phrase for- 
mat suggested by Scott was therefore adopted for use in further research, and single-word stimuli 
were transformed to phrases. 

The total stimulus word list was examined by category. Within each category, single words 
intended to represent important aspects of the work environment were transformed to the concept 
piiiase representative of that aspect. For example, the single word "influence" was translated into 
the two phroses "my control over work pace" and "my control over work methods." The words 
used in Experiment I were given preference, since they had previously been selected as representative 
of the work categories. Table 5 lists the resulting 40 concept phrases developed to be representative 
of the several categories of work. 

The use of concept phrases reduced both the original numbar of work categories and the number 
of stimuli used to represent the work environment. For example, the investigators felt that the 
ohrases "opportunities for on-the-job training," "use of my abilities at work," and "my competence 
at work" served as well as the six single word stimuli to effectively represent an associative domain 
concerned with both the subcategory Success and Failure in Performance of Job & the subcategory 
Skills and Abilities of Worker . Hence, the number of stimuli used to represent the combination of 
thefe two subcategories was reduced from six single words to three phrases, and since these phrases ap- 
peared to represent both subcategories, the Skills and Abilities of Worker subcategory was dropped 
as a discrete category labels In a similar manner the subcategories Job Level or Occupational Status 
and Task Components of the Job were represented by stimulus phrases in combination with other 
subcategories and the labels were deleted. The total number of stimuli representative of the work 
environment was reduced from 100 stimulus words to 40 stimulus phrases. The categories Attributes 
of Worker and Adjectives were not represented by stimulus phrases. The phrase form of a stimulus 
word contained within these categories would still have been a descriptive one, and the results of 
Experiment I suggested that such descriptive stimuli would elicit responses representing only a nar- 
row range of the psychological meaning of the work environment (i.e., the range of interpretable 
meaning would be limited to the affective dimension and would not include those related and im- 
portant cognitively based responses).,^ 



Summary 

A phrase form of stimuli was developed to replace the single-word form. Experiment I indi- 
cated that word association methods, using single-word and sentence-stem form of stimuli, was 



Sec Appendix A for the responses elicited by adjective stimuli in Experiment I. 
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inadequate to investigate the non-technical, psychological meaning of the work environment. A for- 
mat suggested by Scott (1967) appeared to resolve the major difficulties. The suggested format in- 
voled transforming stimulus MUXiS into stimulus phrases . This resulted in both fewer work-related 
categories and fewer stimuli to represent those categories. Descriptive words were not transformed 
into phrases since Experiment I results suggested that descriptive phrases were Inefficient stimuli. 
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CHAPTER V 



EXPERIMENT II 



The results of Experiment I were generally supportive of a number of features of the word as- 
sociation method to investigate the non-technical, psychological meaning of work-related stimuli. 
But, results also suggested that the Experiment I methodology needed to be changed in two ways 
for further investigations to be successful in defining the affective and descriptive meaning of the 
work environment. 

First, emphasis should be shifted from a dimensional analysis of the stimuli to a dimensional 
analysis of the response words. Experiment I indicated that the dimensional analysis of word as- 
sociation stimuli was confounded by the inability of the overlap measure to account for the psycho- 
logical equivalences and differences between response distributions. Further, the RC measure of 
relatedness did not include all of the semantic information contained within the response distribu- 
tions. Therefore, the hierarchical factor analysis of the RC matrix could not be interpreted clearly; 
the analysis lacked face validity and could not be used as a context for interpreting the responses 
given to a particular factor member. The results suggested that stimulus meaning should be derived 
from the associative responses themselves (i.e., from a content analysis of response distributions). 

Second, the stimulus form should be changed in order to delimit associative responses to those 
relevant to a subject's present job and exclude irrelevant artifactual responses like "work" and "job," 
without constricting associative responses of an affective nature. It was felt that such focusing of 
the subjects' associative response domain could facilitate content analysis and could be accomplished 
by transforming single-word stimuli to phrase-form stimuli. 

Use of Response Word Categories 

The results of Experiment I also suggested that the same response word can have different psy- 
chological meanings in the context of different stimuli. In Table 3, for example, the response 
"performance" was given to both the stimulus word "schedule" and the stimulus word "fatigue." 
In the former context "performance" is used as a modifier to indicate a work routine or task sequence 
while in the latter context "performance" labels a causative factor in fatigue. Therefore, it would be 
helpful to determine the psychological meaning of responses within the context of the eliciting stim- 
ulus phrases. This would account for any shift in meaning an associative response might have when 
considered in the context of different stimulus phrases, as in the example listed above, and would 
reflect more accurately the associative meaning of each phrase. One method of accounting for shifts 
in meaning across contexts would be to establish a set of common associative response categories that 
would classify all the associative responses given to all the stimulus phrases. Then, the associative re- 
sponses given to each stimulus phrase would be categorized independently of responses given to 
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other stimulus phrases. That is, the meaning of each response would be considered in the context 
of its eliciting stimulus phrase, and only its eliciting stimulus phrase, thereby assuring that the re- 
sponse would be assigned to the most meaningful category. 

The use of associative response categories would clearly facilitate content analysis and also 
would suggest an associative structure of meaning for the work environment as follows: since any 
contextual meaning-shift of each associative response is accounted for, a clear content and pattern 
of meaning for each stimulus phrase could be derived by examining the distribution of responses 
across all of the associative response categories. Any differential or disproportionate category usage 
would reveal those aspects of each stimulus that subjects have emphasized, making it easier to fur- 
ther determine the exact meaning of each stimulus phrase. Hence, associative response categories 
would facilitate content analyses. At the same time, the associative response distribution pattern, 
or differential usage of associative response categories within each stimulus phrase, would allow 
comparisons between and among stimul"-; phrases to reveal similarities and differences in the patterns 
of meaning. Since each stimulus phrase conceptualizes one facet of the work environment, similarities 
and differences in meaning among or between . nulus phrases would illustrate the relationship be- 
tween aspects of the work environment, a relatiunship that would reflect an associative structure of 
the work environment. 

However, the use of response word categories must clarify, not distort, the meaning character- 
istic of the distribution of responses given to each stimulus phrase. Response word categories must 
be flexible enough to accurately reflect the semantic sense or part of speech that each response word 
represents. A review of response-word category usage in word association suggested that it was pos- 
sible to establish categories that would not distort the responses and would be an aid in content 
analysis (e.g., Kreitler & Kreitler, 1968; Laffal & Feldman, 1962). 

One particular method suggested by the review seemed most appropriate to the present investi- 
gation. Kreitler and Kreitler (1968) reported a method to determine response categories that were 
a function of the responses themselves. Kreitler and Kreitler asked judges to independently label 
statements given in response to stimulus words. The label represented that aspect of the stimulus or 
its reference conveyed by the statement After semantic differences were resolved in discussion and 
the labels with common denominators were grouped together, the unanimity in labeling among inde- 
pendent judges was complete in 99% of the cases. Thirteen distinct labels enabled the grouping of 
97.2% of the statements into clearly defined groups or categories. 

A preliminary test of this approach, using th } data from Experiment I, indicated that the 
Kreitler and Kreitler method could be used to determine those semantic categories of responses that 
were actually represented by the response words themselves. Further, when a sample of categorized 
response distributions were subsequently content analyzed, the psychological meaning usually could 
be determined. There were some difficulties in interpreting certain response distributions. These 
difficulties, however, were attributed to anomalies within the Experiment I data (e.g., the presence 
of the responses "work" and "job"). 

This preliminary test of the Kreitler and Kreitler method also suggested that the use of response 
categories could facilitate comparisons between occupational groups. To ensure the appropriateness 
of response categories to all occupational groups sampled, the categories were developed from the 
pool of responses compiled from all subjects, across all occupations. 
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Research Questions 



This investigation was concerned primarily with the following research questions: 

1. For subjects in a range of occupations, can work-related stimulus phrases 
elicit responses containing multiple semantic levels, all relevant to the 
subjects' personal work environments? 

2. Will phrase-form stimuli, along with appropriate instructions to subjects, 
activate a work-related affective response domain? 

3. Will subjects' pooled responses be useful to establish response categories 
common to all stimulus phrases and all occupations, categories that will 
both accurately classify responses and aid in determining the psychological 
meaning of each stimulus phrase? 

4. Will an examination of the categorical distribution of responses within 
each occupation facilitate the inter-occupational comparisons and aid 

in determining the psychological meaning of each stimulus phrase within 
occupations? 



Method 

Subjects 

Subjects were 19 automotive mechanics (all males), 19 secretaries (all females), and 19 computer 
data processors (14 males) employed in the metropolitan area of Columbus, Ohio. Ages ranged from 
less than 21 to more than 46 years within each occupation.^ The modal age range for all subjects 
was 31-35 years. All subjects had been employed for one or more years within their occupation, 
averaging 11.3 years, 6.6 years, and 7.4 years on-the-job experience for automotive mechanics, 
secretaries, and computer data processors, respectively. Data were collected at 1 5 different employ- 
ment locations in sample sizes ranging from one to seven subjects. 



Instrumentation 

The 40 stimulus phrases listed in Table 5 (i:ee page 31) were prepared in a continued-association 
format. That is, each phrase was printed in a column 15 times on a single sheet of 872" x 11" paper, 
each repetition followed by a blank line, as follows:. 



6it .s not possible to report the exact age of any subject Subjects were asked to check one of several blocks, 
each representing an age range of five years. However, the lowest age range block was labeled "under 21 , and the 
highest Wc^s labeled "over 46." 

35 ^ 



job knowledge 



job knowledge 
job knowledge 
job knowledge 



etc. 

Fifty-seven booklets of 40 pages each were then collated in six different randonr> orders. In ad- 
dition, each booklet contained a background information sheet appropriate to one of the occupation- 
al groups in the sample, a completed example of the word cssociation task, and key portions of the 
instructions read to the subjects.^ Each set of 19 booklets appropriate to an occupation contained 
at least three different random orders of the 40 stimulus phrases. 



Procedure 

Data collection . Subjects were told that the stimulus phrases were constructed to find out what 
work means to people and what people think and feel about their work. Subjects were instructed to 
write responses that best expressed what each stimulus phrase meant to them in relation to their work 
situations. The experimenter asked all subjects to note that the completed stimulus phrase examples 
on the second page of each booklet contained many different single-word responses and that all exam- 
ple responses were appropriate. Subjects were asked to give single-word responses but were allowed 
to give multiple-word responses if they could not think of single-word responses. Finally, instructions 
were given to write as many responses as the stimulus phrases made them think of within the time 
allowed for each phrase. A 500 Hz, pre-recorded tone sounded on a tape recorder at 50 second in- 
tervals to signal the subjects to stop writing, turn the page, and begin writing responses to the next 
stimulus phrase. Each subject completed the task in a single test session. Following completion of 
the task, subjects were given additional information about the purpose of the experiment, and the 
exoerimenter answered subsequent questions. 

Category development . The responses from all 57 subjects were pooled for each of the 40 stim- 
ulus phrases. However, a response was pooled only if it was given to a stimulus phrase by at least 
two subjects. These data were used to develop response word categories and are listed in their en- 
tirety in Appendix D. 

Response categories vvere developed using a two-stage method suggested by Kreitler and Kreitler 
(1968). First, three judges, all educational researchers, were asked to independently examine the 
pooled response distribution for each stimulus phrase. Then, within the context of a stimulus phrase, 
judges were asked to determine which aspect of the stimulus phrase or its reference was conveyed by 



^See Appendix B for stimulus phrase format data collection instrument.. 
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each response word. Next, those response words that conveyed a common aspect were grouped to- 
gether and assigned a label or a response category heading. For example, the responses "boring" and 
''exciting/' given by computer data processors in response to the stimulus phrase "my job/' were 
judged to convey a common aspect of the job, an aspect that judges subsequently assigned the label 
Action . This process was repeated for each stimulus phrase response distribution. 

In the second stage of the categorization, judges worked together and were required to reach 
100% agreement on each step. First, judges were required to reach agreement upon the groupings 
of responses within each response distribution and the labels assigned to each group. Next, judges 
were required to agree upon the minimum set of labels or categories which could subsume all re- 
sponses given to all stimulus phrases. 

After semantic differences were resolved in uiscussion and the labels with common denominators 
were grouped together, there remained 13 categories of associative responses. Judges were then re- 
quired, as a group, to derive a definition for each of the response categories. 

Data analysis . Following the development of response categories, several analyses were performed. 
First, a content analysis was made on the pooled, categorized, response distributions given by all 57 
subjects to a sample of seven stimulus phrases. Each stimulus phrase was considered a key representa- 
tive of one of the seven different work-related categories. 

Second, atl responses given by the 19 subjects within each occupation were pooled for each of 
the 40 stimulus phrases. These response distributions are reported in Appendix B. These data sepa- 
rated the previously categorized, pooled associative response distributions into three occupational 
distributions, across the 13 common response categories. The three occupational distributions were 
then content analyzed and compared for inter- and intra- occupational similarities and differences 
in meaning. 



Results and Discussion 

Categories and Meaning 

Response category development. The 13 conceptually distinct response categories derived by 
the judges are presented below, showing their percent of use. The percent of use represents the pro- 
portion of response words included in a particular category to the total number of response words 
(as listed in Appendix B). The categories, ranked by percent of use, were as follows: 

1. Description or evaluation of the referent (52.10%) Responses included in this category in- 
dicated both relatively enduring descriptive qualities (e.g., me at work-responsible) and pure evalu- 
ation of the referent in terms of positive-negative polarity (e.g., my supervisor-good). It did not 
include responses that constituted the abstract or physical material of which the referent consisted. 
Not included were respon:^;^ that indicated both evaluation and one of the following aspects of the 
referent: action, frequency, quantity, or potency (e.g., my opportunities to do a variety of tasks- 
too many; opportunities for on-the-job training-not enough). These responses were included in the 
Action, Frequency , Quantity , and Potency categories described below. 
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2. Referent's saliency (10.23%) Responses included such terms as importance, necessity, and 
need (e.g., use of my abilities at work-necessary). 

3. What the referent consists of or includes (7.46%) Responses included references to the ab- 
stract or physical material of which the referent consisted (e.g., opportunities to help others in the 
community-service), or to the items or parts which made up the referent (e.g., equipment used on 
my job-tools). The latter illustrates identification of the referent as a superordinat-^ concept or 
structure. 

4. Referent's quantity or amount (7.05%) The following illustrates the responses included in 
this category: my working hours— eight. 

5. Referent's action(s) or potential for action(s) (5.76%) Responses included indication of th^: 
referent's level or potential level of activity (e.g., me at work-busy or efficient); the novelty inherent 
to the referent (e.g., my opportunities for on-the-job training-variety); and indication of the referent 
as an invigorating, activating, or potentially activating force (e.g., my working conditions-relaxing 
or tense; my job— dull or exciting). 

6. Causes for the referent's occurrence/non-occurrence (5.49%) This category included responses 
describing the conditions for the referent's occurrence/non-occurrence or existence/non-existence 
(e.g., daydreaming at work-boredom or no- time). 

7. Referent's frequency of occurrence (5.34%) The following illustrates the responses included 
in this category: my overtime work-infrequent. 

8. Referent's potency (1.89%) Responses indicated power and the things associated with power 
such as size, weight, and toughness (e.g., my prestige in the community-high; my supervisor's ability 
to handle people— strong). 

9. Consequences which result from the referent's existence or from one of its activities (1.60%) 
Included were responses which did not imply the prime function, purpose, or role of the referent 
(e.g., my accomplishments at work-confidence). 

10. Referent's function, purpose, or role in the context of the worker (1.21%) Included were 
responses describing the uses to which the referent may be put and is usually put (e.g., my pay— se- 
curity; work methods— accuracy), 

1 1 Referent's manner of occurrence (0.98%) Included responses describing a series of acts, 
activities, or operations characteristic of the referent as a dynamic process (e.g., my self-confidence 
at work— learning or training). 

12. Referent's simiiarity or contrast to other referents (0.61%) The following illustrates the 
responses included in this category: my job-work. 

13. Referent's contextual allocation (0.15%) Included responses to the abstract or physical 
structure to which the referent belonged oi oi which the referant formed a part. 
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The above response categories included 99.87 percent of the pooled responses reported in Ap- 
pendix B. The remaining 0.13 percent were considered inappropriate responses to the stimulus 
phrase (e.g., toe subjects appeared to have responded to another referint) and were not included 
among the response categories. 

These 13 categories replicated 10 of the 13 categories of lexical meaning reported by Kreitler 
and Kreitler (1968) and included the three additional categories of Saliency , Potenc y, and Frequency . 
The mean number of categories per stimulus phrase was 4.97 categories (SD=1.35), as compared to 
2.80 categories (SD=1.34) per stimulus word reported by Kreitler and Kreitler. This outcome was 
somewhat surorising since Kreitler and Kreitler's subjects were allowed to free associate to single 
words and to respond with sentences, a much richer form of communication. It had been expected 
that the present investigation would reveal substantially fewer categories, given the phrase form of 
the stimuli and instructions to try to limit responses to single words. However, the number of cate- 
gories developed here suggested that single word responses can reveal one or more lexical or semantic 
aspects of the stimuli as well as sentence- form responses. Both studies, Kreitler and Kreitler (1968) 
and the present one, clearly supported the use of word association techniques to investigate the broad 
meaning of stimuli., 

The work-related stimulus phrases, as expected, elicited multiple-semantic levels of responses 
representing various aspects of the work-related stimulus phrase. This was interpreted as a partial 
answer to the first of the four research questiorib posed for the study. Pooled responses were useful 
for establishing general semantic categories, and this was considered an affirmative response to the 
third research question. 

The Description/Evaluation category was sufficient to include 52.10% of all responses, approxi- 
mately five times as many as were included in the next largest category. Additional value-laden re- 
sponses were included in the remaining 12 categories, which supported the expectation that the re- 
sponse distributions would emphasize the affective meaning of the work environment (research ques- 
tion two). Given that the instructions used in Experiment 1 1 were little different from those used in 
Experiment I, the phrase form of the stimuli was considered the major factor in establishing an af- 
fective response set. 

The phrase form of the stimuli and the instructions that en^ouraged single-word responses ap- 
peared to be major reasons for the under-representation of responses within the Contextual Allocation 
(0.15%), Similarity/Contrast (0.61%), and Manner of Occurrence (0.98%) categories. The stimulus 
phrases provided a work-related context and encouraged descriptive rather than comparative responses. 
Also, use of the single-word response set made it difficult to characterize the referent as a dynamic 
process. 

Content and structure of meaning in order to determine the extent to which associative re- 
sponses revealed detailed affective and aescriptive meaning, the pooled and categorized response 
distributions for seven selected stimulus phrases were content analyzed. The distributions are re- 
ported in Table 6. The seven sti-nulus phrases were selected to represent each of the seven general 
categories of work described eai lier (see Table 5). A brief discussion of ths content analysis follows. 

The categorical distribution of responses among the seven selected stimulus phrases allowed 
comment on particular aspects of the stimulus phrases. The response categories themselves turned 



out to be general modes of classification of phenomena, categories which appeared similar to what 
have been termed "attributes" or "dimensions" in studies of concept formation (Kreitler & Kreitler, 
1968). 

The content and structure of meaning was inferred from the pattern of responses within and 
among response categories. Thus, the meaning of a stimulus phrase was inferred from an examination 
of the responses contained within each of the response categories. For example, a part of the meaning 
of the stimulus phrase "my job" was inferred from an examination of responses within the response 
category Function . In general, as shown in Table 6, the sample of 57 subjects apparently viewed their 
job as a source of security and friends and, most of all, as a source of money. 

Additional meaning and a structure of meaning for stimulus phrases was inferred from the com- 
parison of responses across response categories. For example, when responses within the Description/ 
Evaluation response category and within the Action response category were compared for the stimulus 
phrases "my job" and "me at work," they suggested that the workers generally had characterized their 
job as rewarding and interesting and themselves as happy and busy. A few workers, however, described 
their jobs as dirty and boring and themselves as dissatisfied at work and as performing routine actions. 

Thus, in response to the third research question posed for this investigation, response categories 
were useful in helping to identify the meanings workers associated with stimulus phrases. The responses 
within each of the associative response categories were examined to infer one aspect of meaning, while 
the responses among the several categories were examined to infer a structure of meaning. 

These analyses of the categorized respor^ei? to all stimulus phrases revealed that artifactual re- 
sponses were not present in the Experiment 1 1 data. The words "work" and "job." ubiquitous in 
Experiment I, were virtually non-existent within these pooled response distributions, and there was no 
evidence of other systematic, artifactual responses. Absence of artifactual responses was interpreted 
as further affirmation of the first research question posed for Experiment !l. Further, responses were 
found to be relevant to the subjects' personal environment. Responses in Table 6 indicated clearly 
that the subjects' responses were specific to the work-related domain outlined by the stimulus phrase 
jnd represented personal viewpoints. The content analyses described briefly above indicated that 
response categories could be derived from pooled response data and could facilitate the identification 
of meaning. 



Occupational Comparisons 

Response distributions for each of the three sample occupations are reported in Appendices 
B-3. B-4, and B-5 and are categorized in Tables 7 through 12. Appendices B-3, B-4, and B-5 report 
aM of the responses givsn within each occupation, by stimulus phrase and frequency of response. 
Tables 7 through 12 report only those occupation-specific responses given to each stimulus phrase 
by at least two subject*; in the occupation. Thus, these tables do not contain all of the responses pre- 
viously reported in the response distributions pooled across occupations and categorized in Table 6. 
A response was included in the pooled distribution and reported in Table 6 if it was given to a stim- 
ulus phrase by two or more of tr. : 57 subjects regardless of which occupation they represented. 

The response distributions reported in Tables 7 through 12 were content analyzed to determine 
the specific occupational meaning of the stimulus phrases. As an aid in these content analyses, the 
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Evaluative Dominance Index (EDI), suggested by Szalay and Lysne (1970), was used to index the 
dominance of positive or negative valuative responses as a portion of all the responses given by two 
or more workers to each stimulus phrase by each occupational group. The term "affective" was 
substituted for the terc.i "evaluative" in the name for tne index since the response distributions were 
determined to represent several dimensions of affect: emotion, interest, feelings, and values. Collect- 
ively, these dimensions parallel those outlined by Krathwohl et al. (1964) and support the conceptual- 
ization of affect offered in Chapter I.: The ADI was computed for each stimulus phrase and separately 
for each occupational qronn as follows: 

Affective Dominance Index (ADI) = 

^positive responses, rrequencies>2 - ^negative responses, frequencies^ 



£all responses, frequencies >2 



X 100 



The ADI ranges in numerical value between plus and minus 100. The sign indicates the direction of 
the affect (i.e., plus for a positive direction and a minus sign for a negative direction), and the numer- 
ical value reflects intensity of affect. Responses to each stimulus phrase were first judged as positive, 
negative, or neutral in value. Subsequently, the totals were used in the computation of the API's 
which are reported in Table 13, by stimulus phrase and occupation. 

With few exceptions, the entries in Table 13 are positive, reflecting the overwhelming percentage 
of responses judged as indicating positive valuation. Overall, the table indicates that the subjects viewed 
their work environments much more positively than negatively.. Similarly, Gottleib (1973) reported 
that the majority of 1,860 male and female college seniors expressed favorable attitudes toward work 
and saw work as a critical and necessary part of life. Thus, a positive view of the work ethic is not 
uncommon. In the following discussion of the occupation-specific content analyses, it was deemed 
unnecessary to repeatedly note positive associations. Instead, the reader should assume that the ma* 
jority of the responses to each stimulus phrase were positive. The exceptions, those phrases which 
elicited a majority of negative responses, are noted and discussed. Tables 7-12 each represents one 
of the general work categories and each is discussed separately. 

J ob Content (Table 7). A relatively small contingent of computer data processors indicated 
that their jobs were boring, that there were few opportur)ities to do a variety of tasks and limited 
opportunities to do challenging work. The majority indicated just the opposite. Responses also in- 
dicated that the majority of computer data processors felt that on-the-job training was very good 
and their abilities were being well used; they felt competent and exercised control over their work 
pace. Data processors rated control of work pace the most important concept within this work 
category. Of the three occupations sampled, only data processors indicated that they associated 
their job with a career. 

A relatively small but consistent number of secretaries felt some boredom on the job and char- 
acterized the work pace as slow. They felt they had limited chances to do challenging work and that 
much of their abilities were not being used. However, the variety of tasks accomplished seemed re- 
latively high, which seemed to characterize the secretaries' job content as varied but less-than demand- 
ing. Related to this, self-competence was rated high, suggesting that some secretaries had achieved a 
high level of competence in performing routine work. On-the-job training for secretaries was consider- 
ed very necessary and important, which again suggested the need for additional, challenging work. 
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Table 13 

Index of Affective Dominance By Occupation. Work Category and Stimulus Phrase 



Work Category 



Data 
Processors 



Secretaries 



Automotive 
Mechanics 



Job Content 



my |ob 


44 


61 


62 


my opportunities to do a variety tasks 


47 


65 


65 


my opportunities to do challenging work 


25 


29 


100 


work methods used on my job 


67 


100 


20 


wcrk pace usea on my job 


•23 


•19 


0 


my cont.ol over work methods 


100 


100 


37 


my control over work pace 


0 


33 


14 


interference with my |ob 


33 


•33 


33 


use of my abilities at work 


40 


27 


87 


my competence at work 


37 


100 


62 


opportunities for on-the-job training 


100 


59 


69 




Avg. 52 


Avg. 50 


Avg. 50 



General Need Satisfaction 



me at work 


86 


51 


100 


my |ob security 


100 


100 


29 


my fellow workers 


100 


77 


100 


interaction with m coworkers 


76 


100 


90 


opportunities to help others in the community 


0 


75 


75 


moral "ri^tness" of my job 


33 


100 


100 


recognition for my work 


50 


44 


20 


my prestige at work 


100 


0 


100 


prestige of my job in the community 


100 


17 


11 


freeaom to use my own judgment at work 


100 


0 


78 


my self-confidence at work 


54 


50 


82 


opportunities for self-fulfillment 


40 


38 


61 


feeling of accomplishment at work 


78 


57 


75 


daydreaming at work 


33 


•100 


-75 


Avg. 


63 


Avg. 43 


Avg. 71 



Working Conditions 

my working conditions 
my working hours 
eouipme'^t used on my job 
my overtime work 
my coffeebreaks 



100 
100 
71 
33 
82 



91 
50 
39 
09 
73 



Avg. 



77 



Avg. 



52 



Avg. 



50 
32 
29 
57 
60 



4d 



Supervision 

my supervisor 

supervisor's ability to handle people 
interaction with my supervivir 
supervisor's evaluation of my work 



100 
71 
100 

100 



100 
86 
100 

69 



Avg. 



93 



Avg. 



89 



Avg. 



91 
100 
78 
60 



82 



Company and Union 

company policies on my job 
handling of grievances on my job 
the union or, my job 



100 

22 
•33 



69 
15 
12 



>wg. 



30 



Avg. 



32 



Avg. 



73 
0 
0 



24 



Compensation 
my pay 

my opportunities for promotion 
my fringe benefits 



62 
0 
65 



47 

•12 
64 



Avg 



42 



Avg. 



33 



Avg. 



25 



04 



Total Average 



61 



49 



51 
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Most automotive mechanics viewed their jobs positively and indicated that its most important 
function was as a source of ir.^ome. The mechanics' jobs were seen as challenging and as ones that 
used their abilities which, collectively, seemed to be the key to why on-the-job training, self-compe- 
tence, and control over work pace were rated very important and r>ecessary. The work pace was 
fast, and some mechanics indicated no control over work pace or work method. Briefly, the auto- 
motive mechanics' jobs seemed to be demanding, challenging, and, in many cases, done strictly by 
the book, as fast as possible. The jobs were seen as rewarding, and it was possible to construe much 
of that reward 3S money. 

Comparisons between occupations were facilitated by the occupational ly-srjecific ADI's com- 
puted for f ach stimulus phrase. For example, the ADI's for each of the stimulus phrases within the 
Job Content category differentiated between the three occupations, with the exception of the ADI's 
for the stimulus phrases "my job" and "opportunities to do a variety cf tasks. ' Further, the ADI's 
provided a useful affective summary index of the detailed content analyses. This allowed inter- and 
intra-occupational comparisons to be made at a glance. Thus, the ADI's indicated, for example, 
that atuomotive mechanics viewed their opportunities to do challenging work and on-the-job use of 
their abilities more positively than did either computer data processors or secretaries. As discussed 
above, content analysis of the associative responses supported this last conclusion. The ADI's also 
indicated that the secretaries felt more self-competence on the job and were wore accepting of the 
methods used .han were either data processors or automotive mechanics, and data processors felt 
that they had more control over the work pace than did secretaries or automotive mechanics. Both 
examples again illustrate that the ADI serves as a useful summary index for comparative purposes 
and that the index is sensitive to the polarity and intensity of attitude. 

General need satisfaction (Table 8). Computer data processors characterized themselves as 
happy and efficient. They indicated a feeling of accomplishment and self-confidence at work and 
felt that they were free to use personal judgment. Computer data processing appeared to offer high 
job security and personal prestige on the job and in the community. Fellow workers were positively 
described, and interaction with co-workers was rated highly. To a lesser extent, data processor i in- 
dicated that their work received recognition. 

On the other hand, a number of data processors indicated that their opportunities for self-ful- 
fillment and opportunities to help others was limited. Also, a few questioned the morality of their 
occupation. In general, computer data processing, as an occupation, seemed to satisfy the security, 
social, and autonomy needs and, to a lesser extent, the esteem and self-actualization needs. 

Responses indicated that some secretaries were often bored and dissatisfied with their jobs. 
Secretaries indicated that their position had low prestige at work and in the community, there were 
few opportunities for self-fulfillment, and freedom to use personal judgment was limited. To a 
lesser extent, secretaries indicated that they lacked a feeling of accomplishment. A few recponses 
indicated that some secretaries were critical of their fellow workers. 

On the positive side, the secretaries indicated that their jobs were secure and morally defensible. 
Interaction with fellow orkers was good, and opportunities to help others in the community was 
rated highly. The security and social aspects of the secretaries' jobs were the major sources of need 
satisfaction. The higher order needs, esteem, autonomy, and self-actualization, were evidently not 
part of the secretarial job structure. 
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Automotive mechanics responses to the stimulus phrase "me at work" included "clean," "fair," 
"honest," "neat," and "busy." Fellow workers and interaction with fellow workers were described 
positively. Mechanics indicated that they were self-confident in their work, aud felt that freedom to 
use their personal judgment was a function of experiences and ability and was not otherwise limited. 
Responses further indicated that the morality of the occupation and opportunities to help others 
were viewed favorably. Prestige on the job was rated favorably and seen as a function of experience. 
Negatively speaking, auto mechanics indicated that job security was not guaranteed and surprisingly, 
not considered salient by a large number of subjects. Further, responses indicated that mechanics' 
prestige in the community was considered debatable. 

Automotive mechanics' responses to the stimulus phrases "opportunities for self-fulfillment," 
"feeling of accomplishment at work," and "recognition for my work" revealed the important place 
that money occupied in the structure of their jobs. The responses to the three phrases indicated that 
opportunities for self-fulfillment and feelings of accomplishment were good, but that recognition for 
their work was sometimes not forthcoming. In all tnree phrases, the response "money" was present, 
suggesting that it was a salient factor in general need satisfaction. Overall, the auto mechanics' job 
structure was a better source of satisfaction for the relatively higher social, autonomy, and self-actual- 
ization needs than for security and esteem needs. 

Comparisons between occupations for the General Need Satisfaction category of work revealed 
several similarities and differences in the structure of the work environment. With the noted excep- 
tions, subjects in all occupations described themselves positively, felt self-confident, and saw their 
opportunities for self-fulfillment as somewhat limited. In general, subjects described their co-workers 
positively and unanimously viewed interaction with co-workers favorably. 

Computer data processors enjoyed a more prastigous occupational position and indicated a 
higher feeling of accomplishment than did either secretaries or automotive mechanics. Both data 
processors and automotive mechanics were free to excercise more personal judgment than secretaries. 
Automotive mechanics alone stressed money as an important factor of the job and shared with data 
processors a high prestige at work. Secretaries viewed interaction with their co-workers as more im- 
portant than did data processors or automotive mechanics. Finally, both data processors and secre- 
taries indicated that job security was a more salient and more prevalent aspect of their jobs than did 
automotive mehchanics. 

The ADI's reported for each stimulus phrase in Table 13 in general reflected the similarities 
and differences revealed by content analysis of associative responses in the General Need Satisfaction 
work category.: Also, since the secretaries reported fewer sources of need satisfaction than did either 
data processors or automotive mechanics, the average ADI for all stimulus phrases within this work 
category rather accurately indicated a less positive AOI for secretaries than for automotive mechanics 
and data processors. 

Working conditions (Table 9). Computer data processors indicated that overtime work was a 
relatively necessary part of the job and occurred, in some cases, without pay. The working hours 
were generally good and were busy. The equipment was considered modern and often interesting. 
Coffee breaks were relatively short, relaxing, necessary, and could even be useful. Data processors 
reported that the working conditions per se were good, and "my working conditions" was considered 
the most salient concept within this category. 
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Secretaries considered overtime as relatively unnecessary and unfair. They also indicated that 
overtime was rare and sometimes resulted in compensation, suggesting that some secretaries did not 
receive pay for their overtime work. The response "unfair" would support this co.itention. Related 
to this, some secretaries indicated that the working hours, while generally good, were long. 

Secretaries rated the equipment that they used as a salient part of their environment and listed 
a number of different items that were often used. Responses further indicated that coffee breaks 
were relaxing and provided the chance to talk to friends. "Coffee breaks" was considered the most 
salient concept in this work category. 

Automotive mechanics indicated that overtime was not common, but was helpful, and definitely 
meant more money. Responses further indicated that the mechanics working conditions were dirty 
and could be better, but this may have been a generally accepted part of the job. The working hours 
were sometimes long and could begin at an early hour. Coffee breaks were short and were considered 
an opportunity to rest. The equipment used by automotive mechanics was considered important and 
some responses indicated that the equipment was old. 

Comparatively, computer data processors considered their working hours and the equipment 
used more favorably than did secretaries or automotive mechanics. Automotive mechanics were 
unique in viewing overtime positively. The ADI for stimulus phrases within this category. Working 
Conditions , again reflected the import of the content analyses. Data processors gave fewer negative 
responses overall than did the secretaries and considerably fewer than automotive mechanics, and 
this is accurately indicated by the average ADI for each occupation. 

Supervision (Table 10). Computer data processors indicated that interaction with their super- 
visor was necessary, and a few data processors indicated that their supervisors' ability to handle 
people was poor. 

Secretaries indicated that i^^teraction with their supervisors was the most salient concept in this 
work category, reflecting the r jre of the supervisor- secretary relationship. Relatively few of the 
secretaries' responses indicated that some supervisors' ability to handle people was not good. 

The majority of automotive mechanics' responses indicated that the "supervisor's evaluation of 
my work" was the most necessary concept within this work category. However, a few responses in- 
dicated that for some mechanics the supervisors did not evaluate their work. A small r.jmber of 
automotive mechanics indicated that their supervisors' evaluation was poor. 

In comparing occupaVions it was clear that stimulus phrases within the Supervision work 'cate- 
gory had collectively elicited responses with the highest positive Itvel of valuations when compared 
to the other work categories. Both content analyses of associative responses and the average ADI's 
supported this conclusion. However, it was interesting to note that none of the subjects, in any of 
the three occupations, indicated that the supervisor was either necessary or important These occu- 
pational content analyses of the responses to phrases within this work category essentially reflected 
the differences and similarities between the three occupations. 

Company and union (Table 1 1 Computer data processors indicated that company policies 
were flexible and that the handling of gne^/ances was usually an informal process. In addition, the 
union was seen as an unnecessary part of the job. 
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Secretaries indicated that there had been few grievances on the job and that these had been 
handled both formally and informally. However, the union was considered necessary by a few sub- 
jects. 

Automotive mechanics appeared to disagree on the necessity of a union. Company policy con- 
cerning cleanliness and tardiness appeared to be an important aspect of the mechanics' jobs. 

The majority of subjects in alt occupations indicated that they did not belong to unions. Also, 
a small number of subjects in all occupations felt that the handling of grievances was poor.. Only a 
few secretaries indicated that company policies were unfair.: 

Compensation (Table 12). The results of the occupational content analyses and comparisons 
between occupations have been combined in the following discussion of this work category. 

Within the three occupations, secretaries alone considered fringe benefits a salient part of the 
job, and only automotive mechanics indicated that there were either limited or no fringe benefits. 
A few workers in each occupation indicated that pay was inadequate. 

Computer data processors indicated that the chances for promotion varied and were perhaps 
keyed to performance. The majority of responses reported for both secretaries and automotive me- 
chanics indicated that promotion was not generally a possibility; again, this was clearly reflected in 
the ADI's. 

The content analyses of Tables 7-12 indicated that the use of response categories could aid in 
determining the psychological meaning of each stimulus phrase within occupations and could facili- 
tate intei occupational comparisons (research question four). Content analyses of categories allowed 
two aspects of the psychological meaning of the work environment, content and structure, to be 
determined in detail for each occupation. Further, the use of categories allowed detailed comparisons 
of similarities and differences between occupations for all aspects of the work environment. 



Summary 

Using the word association paradigm an attempt was made to determine the non-technical psy- 
chological meaning, especial' / the affective meaning, of the work environment for groups of workers 
in three different occupations. Methodologically, this was accomplished by first using work-related 
phrases a<> stimuli and instructing subjects to write responses that best expressed what they felt to- 
ward each stimulus and what it meant to them. Second, a dimensional analysis, by occupation, was 
performed on the responses. This was accomplished by first deveiopmg categories that were a func- 
tion of associative responses given by subjects from all occupations and then separating these cate- 
gorized associative responses by occupation. Finally, the ADI statistic was used to summarize the 
affectivity workers assigned to each of the stimulus phrases.. 

Content analyses of the categoriezed associative responses provided empirical support for the 
complexity of affect and for the intimate relationship between affect and cognition.. Meaning often 
emerged as a pattern or structure of value-laden responses given to two or more stimulus phrases. 
For example, automotive mechanics indicated that their jobs were "rewarding," and the general 
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meaning of this word would ordinarily suggest that their jobs satisfied a broad range of needs. 
However, 'n view of the fact that the response "money" was also associated with self-fulfillment, 
recognition, and accomplishment, it was concluded that the automotive mechanic's job was primarily 
financially rewarding, and therefore the response "rewarding" was interpreted in a narrower sense. 

Results of the content analyses provided essentially affirmative answers to the four research 
questions posed for this investigation. It was concluded that the present investigation, using the 
described method^ was effective in determining both tlie content and structure of the affective and 
descriptive meaning of the work environment for computer data processors, secretaries, and automo- 
tive mechanics. In addition, detailed similarities and differences were identified among the occupa- 
tions. 
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CHAPTER VI 



SUMMARY, CONCLUSIONS, AND RECOMMENDATIONS 



Summary 

This investigation was concerned with the development of procedures and techniques to mea- 
sure affect. Specifically, attempts were made to measure the content and pattern of affective mean- 
ing, in the form of verbalized feelings that workers use to describe their work environment; and the 
relation of .hat affective pattern to the more descriptive, cognitive meanings. 

Impetus for the investigation was provided by the current need to establish affective objectives 
in career education. The need for affective objectives, in turn, required detailed information about 
the dimensions of affect that individuals actually use to structure their feelings about their jobs. 
There was, however, no single instrument available to assess the range of affective meaning assigned 
to the work environment. There were at least three reasons for the lack of an appropriate instrument. 
First, affect is complex and multidimensional and may include such variables as personal awareness, 
attitudes, interests, values, and personal characterization (Krathwohl et al., 1964).: Also, affect is 
virtually inseparable from other, more cognitive based components of meaning. Therefore, since 
most affective assessment instruments were designed to exclude assessment of cognition and assess, 
at most, only two or three components of affect, they were considered inappropriate. It was assum- 
ed that a more appropriate measure should reveal the pattern of affectivity and the relation of that 
pattern to the cognitive domain. Second, an appropriate instrument did not exist because there was 
a lack of agreement on which variables in the affective domain should be assessed (Brown, 1971; 
Walther, 1970). Third, because affective development has traditionally been considered outside the 
scope of formal school-based education, there has been little demand to assess affective changes re- 
lated to classroom instruction. It was noted that this view is changing and should no longer represent 
a barrier to instrument development. However, it was concluded that, for ethical reasons, only those 
dimensions of affect that are work-relevant or which facilitate self-development should be considered 
and assessed in the classroom and at work.^ 

A consideration of the above barriers to the development of an appropriate instrument with 
which to investigate the work environment led to the conclusion that a set of systematic techniques 
and methods was needed to identify and assess (a) the multidimensional structure of work-related 
affect and its relation tc the cognitive mediated structure of meaning of the work environment; 
(b) those affective dimensions relevant to the work environment, particularly those related to suc- 
cess; and, (c) the affective dimensions which facilitate self-development. Given these three criteria 
for an appropriate instrument to assess affect, a particularly promising method appeared to lie within 
the word association paradigm. 

Associative techniques, in which a subject responds to a stimulus object by giving the first word, 
image, or thought that occurs to him, have been used successfully in explicating both affective and 
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cognitive mental processes (e.g., Jung, 1910; Wyman, l925;Terwilliger, 1964). Moreover, associative 
techniques have been used to explicate specific psychological domains (e.g., the psychoanalytic ck>- 
main; Rapaport, Gill, & Shafer, 1946). Finally, dimensional analyses of word associations have re- 
vealed multidimensional semantic structures of particular association networks (e.g., Reese, 1960; 
Bousefield, 1957). It was concluded, therefore, that the word association paradigm was approfM'iate 
for the present research goals. That is, such material should delineate associative processes specific 
to .he work environment and should provide means to determine both the content and structure of 
those processes. 

The present investigation was conceived as an attenr>pt to develop procedures which c^uW bt 
used to assess work-relevant affect. The undertaking was considered an exploratory effort which, 
if successful, would suggest a method by which work-relevant affect, a complex phenonr>ef>«i, e^M 
be comprehensively assessed. 



Stimulus Word List Development 

Words given as responses by workers to stimulus objects were assumed to be verbal tags er la- 
bels for underlying concepts. It was further assumed that to assess work-relevant affect, the li«t e# 
stimulus words pre ;b.^ted to workers should be representative of a comprehensive list of aspects er 
categories within the work environment. A review of occupational ly related literature, afong with 
a subsequent nine-member panel review identified the following important categories within tfw 
work environment: 



Job Content . All of the intrinsic aspects of the work itself (but not including those 
aspects listed under General Need Satisfaction, below) including the subcategories 
Assignment and Perceived Complexity of Tasks; Control of Work Methods and 
Work Pace ; and Skills and Abilities of Workers. 

General Need Satisfaction : A hierarchy of basic needs iiKluding the subcategori^ 
Security , the desire for a predictable, structured, reliable environment, and the 
desire for "fairness" and a familiar non-threatening environment; Social , the desire 
for belonging, the desire for association, for acceptance by one's fellows, for giving 
and receiving friendship; Esteem , the desire for reputation or prestige, status, domi- 
nance, recognition, attention, importance, or appreciation; Autonomy , the desire 
for independence and freedom, the desire for achievement, competence, mastery, 
adequacy and confidence; and Self-Actualization , the desire to realize one's own 
potential, the desire for growth and self-development. 

Working Conditions : Included the physical aspects of the work environment; 
equipment used on the job, and the work methods and pace required. 

Hours of Work : Included working hours, overtime work, coffeebreaks. 

Supervision : Included relationships between the worker and his immediate 
supervisor.. 
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Company and Union : Included aspects of the worker's immediate situation which 
are a function of organizational administration such as company policy, handling 
of grievance, and the presence or absence of a union.. 

Compensation : Included wages financial or professional promotions and the fringe 
benefits of a job such as policies that prepare the worker for emergencies, illness, 
old age and hospitalization, holidays, leave and vacation. 

Co-workers: Included relationships between worker and his fellow workers. 

Attributes of Workers : Included relationships between workers and their fellow workers, 
to a wide range of occupations. 

Adjectives : Those adjectives representative of the dimensions of affect ordinarily 
measured by the semantic differential technique (e.g., Osgood, Suci, & Tannenbaum, 
1957). This included the evaluative (e.g., good-bad), potency (e.g., strong-weak), 
and activity (e.g., active-passive) dimensions. 

From the literature discussing each of the work categories, a sample of 21 1 stimulus words was 
selected by the investigators to reflect each category (see Table 1, p.15). From this toidl the investi- 
gators selected 100 words, considered representative of the ten work categories, for use in the first 
of the two experiments. 



Experiment I 

Experiment I attempted to use word association techniques to determine the hierarchical struc- 
ture of the categories of the work environment and to determine the affective meaning workers as- 
signed to stimulus words representing each of those categories. One hundred work-related stimulus 
words were presented to 10 automotive mechanics and 10 secretaries in either single-word or sentence- 
stem form. Each subject was asked to consider each word (or sentence-stem) in the context of his 
job and was given approximately 45 seconds to continuously write single word responses that would 
best tell what each word (or sentence-stem) meant to \V\m and how he felt toward that aspect of his 
job.. 

Associative responses given to each stimulus word/sentence-stem were pooled across workers 
and occupations (see Appendix A). A Relatedness Coefficient (RC), suggested by Gaskoff and 
Houston (1963) was calculated between all possible pairs of stimuli. The RC statistic indexes the 
verbal relation of two stimuli based on both the rank order and the number of shared associative re- 
sponses. Subsequently, a hierarchical factor analysis was performed on the RC Matrix. The result- 
ing factor structure (see Figure 2, p. 24) proved difficult to interpret. A content analysis of the 
pooled associative response distribution for each stimulus revealed several reasons for the difficulty in 
interpretation. First, although the stimuli elicited a wide range of different responses, considered 
necessary in order to determine the associative meaning of the stimuli, the responses "work" and 
"job" were given to over 50% of the stimulus words. These responses, "work" and "job," artificially 
inflated the RC between many pairs of stimuli, which in turn, influenced the factor analytic reduc- 
tion of the RC Matrix. Second, stimuli were interpreted in a wider context than the work 
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environment. Their meaning was apparently ambiguous to subjects or the subjects were not able to 
shield out non-job situations to which the stimuli were also appropriate. Therefore, the factor struc- 
ture itself reflected something more than the structure of categories within the work environment. 
Third, the RC statistic was not sensitive to meaning-shifts that occurred when the same response was 
given to different stimuli. Thus, it only indexed a portion of the shared meaning between stimuli. 
Moreover, the RC statistic could not reflect the rich and unique meaning of responses given to each 
work-related stimulus word. 

It was concluded that although the word association method could elicit a wide range of respons- 
es, reflecting both affective and cognitive processes, the three difficulties mentioned above had to be 
resolved before a meaningful assessment could be made of the structure of affective or cognitive mean- 
ing characteristic of different work environments.. 



Phrase List Development and Use in Experiment II 

Experiment I indicated that single word or sentence stem stimuli lacked the specificity to pre- 
vent the responses "work" and "job" which were considered artifacts, and did not limit responses 
to those relevant to the work environment. This confounded the hierarchical factor analysis and 
prevented a clear content analysis of the responses. In an attempt to reduce che possibility that work- 
related stimuli would elicit such artifdctual associative responses as "work" and "job" and to increase 
the possibility that responses would be relevant to only the work environment, a phrase form of stim- 
uli was adopted (see Table 5, p. 31 ) for use in further investigation. The investigators examined the 
total stimulus word list by work category.: Within each work category those single words that were 
intended to represent important aspects of the work environment were transformed to a concept 
phrase representative of that aspect.. For example, the word "influence" was transformed to the two 
phrases "my control over work pace" and "my control over work methods." Overall, transforming 
single-word stimuli into phrase form reduced the number of discrete work categories from ten to 
five and tho number cf stimuli from 100 to 40. 

Experiment I also indicated that the RC overlap measure could not reflect all of the many dif- 
ferent responses given to each stimulus word. This phenomenon combined with the ambiguity of 
the single word and sentence-stem stimuli to further confound interpretation of the hierarchical fac- 
tor analysis. It was concluded further that dimensional analysis of stimulus words, such as the factor 
analytic solution used m Experiment I, was inadequate because insufficient information was recovered 
from the raw data. Instead, in future investigations, a dimensional analysis of the response words 
themselves would be more desirable.. A literature review concerning the development of response 
categories in word association research indicated that dimensional analysis of associative response 
words was feasible, and a method suggested by Kreitler and Kreitler (1968) was adopted for use in 
Experiment ||. 

In Experiment II the 40 work-related phrases were presented to 19 automotive mechanics, 19 
secretaries, and 19 computer data processors. Procedures, including instructions, were essentially 
the same as those used in Experiment I, with the exception that subjects were instructed to write 
multiple-word responses if they were unable to think of a single word. It was felt that the use of 
stimulus phrases instead of single words, followed by a successful dimensional analysis of responses 
to those phrases, would reveal the pattern of affect and its relation to other more cognitive meanings 
characteristic of the work environment. 
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Associative responses given by all 57 subjects were pooled for each of the 40 stimulus phrases. 
A response was pooled only when it was given in response to a stimulus phrase by at least two sub- 
jects. Using a method of judgment suggested by Kreitler and Kreitler (1968), response word cate- 
gories were developed as a function of the associative responses themselves. Three judges, including 
the investigators, found that 13 categories would account for 99.87% of all responses. These cate- 
gories are listed below along wich their percent of use (See pp. 37-38 for full category definition, 
and Tables 7-12 for the categorical distribution of associative responses.). 

Table 14 

Response Categories ond Their Percent of Use 



Response Categories Percent of Use 



Description or evaluation of the referent 
Referents' saliency 

What the referent consists of or includes 
Referents' quantity or amount 
Referents' action(s) or potential foraction(s) 
Causes for referents' occurrence/non-occurrence 
Refe-c.ts' frequency of occurrence 
Referents' potency 

Consequences which result from the referent's existence 
or from a certain activity it does 

Referents' function, purpose or role 

Referents' manner of occurrence 

Referents' similarity or contrast 

Referents' contextual allocation 



Content analysis of the pooled, categorized data indicated that few artifactual responses were 
present (e.g., "work" and "job" rarely occurred) and that subjects did indeed confine their responses 
to those relevant to the work environment. Following the development of response word categories, 
the pooled responses were sorted by occupation to facilitate inter- and intra-occupational compari- 
sons. This allowed detailed analysis of occupational similarities and differences in content and struc- 
ture of meaning. An Affective Dominance Index suggested by Szalay and Lysne (1970) proved to 
be a sensitive summary statistic which reflected the direction and intensity of the affective responses 
expressed by each occupational group toward each of the 40 work-related phrases. 




52.10% 
10.23 
7.46 
7.05 
5.76 
5.49 
5.34 
1.89 

1.60 
1.21 
0.98 
0.61 
0.15 



Overall, the results of Experiment II indicated th?t people overwhelmingly associate positive 
affect with the work environment. This finding was considered as general support for a positively 
valenced work ethic. This phenomenon brought the negative meaning characteristic of the work 
environment into relief and provided further insight into the structural relationship between positive 
and negative valuation. A brief summary of the major occupational comparisons, by work category, 
follows. Additional findings, especially within each occupation have been discussed in Chapter V. 

Job content. Automotive mechanics viewed opportunities to do challenging work and the use 
of their abilities more positively than did eit! er computer data processors or secretaries. Secretaries 
felt more self-competence on the job, and were more accepting of the methods used than did either 
data processors or automotive mechanics. Computer data processors felt that they had more control 
over their work pace than did secretaries or automotive mechanics. 

General nee d satisfaction . Overall, l automotive mechanics saw their jobs as a better source 
of satisfaction for the social, autonomy, ana self-actualization needs than for the security and esteem 
needs. For secretaries, the security and social aspects of the job were the major sources of need sat- 
isfaction. The higher order needs, esteem, autonomy and self-actualization were evidently not ade- 
quately met by the secretaries' job structure. Computer data processors generally reported that their 
occupation satisfied security, social, and autonomy needs; and, to a lesser extent, the esteem and self- 
actualization needs. Data processors enjoyed a more prestigious occupation and indicated a higher 
feeling of accomplishment than did either secretaries or automotive mechanics. Both data processors 
and automotive mechanics were more free to exercise personal judgment in performance of job act- 
ivities than were secretaries. Automotive mechanics alone stressed .noney as an important factor of 
the job. They also shared with data processors a feeling of high prestige on-the-job. Secretaries 
viewed interaction with their co-workers as more important than did computer data processors or 
automotive mechanics. 



Working conditions. Overall, computer data processors gave fewer negative associative responses 
than the secretaries, and considerably fewer than automotive mechanics. Data processors considered 
their working hours and the equipment used more favorably than did secretaries or automotive me- 
chanics. Overtime was quite common and considered necessary by data processors; overtime was less 
common for secretaries (who viewed it negatively) and for automotive mechanics (who viewed it as 
financially rewarding). 

Supervision. Stimulus phrases within this work category collectively elicited associative responses 
with the highest positive level of valuations, when compared to other work categories. Data processors 
and secretaries indicated that interaction with their supervisors was more salient than did automotive 
mechanics. None of the subjects in the sample considered their supervisors necessary or important 
in the context of their work environment. 

Company and union. Only secretaries indicated a generally positive view of unions. The major- 
ity of all subjects did not belong to unions. However, a few subjects in all occupations felt that the 
handling of grievances was poor. 

Compensation. A few subjects from each occupation indicated that pay was adequate. Auto- 
motive mechanics and secretaries indicated that promotion is not geneially a possibility.. 



These data empirically reveal multiple aspects or dimensions of affect and they emphasize the 
need to consider the pattern of those dimensions in any assessment of meaning lound in the work 
environment. 

Umitations of the Present Investigation 

It is appropriate here to poin? out certain additional limitations of the study that must be taken 
into account when considering the results. In an earlier discussion (pp. 6-7) it was noted that the 
present effort was an attempt to outline a method to assess complex affective variables. It was viewed 
as a first step toward bridging the gap between awareness of the importance: of aff. otive variables 
in job performance, and establishing affective objectives for use in the classroom. The following ad- 
ditional cor)siderations are appropriate. 

The first limitation on the interpretation of the results is concerned with the size and occupa- 
tional range of the subjects sampled. A deliberate attempt was made to sample diverse occupations. 
Automotive mechanics were viewed as an occupational group that worked primarily with "things/' 
whereas secretaries worked to a great extent with "people," and computer data piocessors worked 
primarily with "ideas" or "data." Nevertheless, these three groups are not necessarily representative 
of all occupations and the size of the samples of workers necessitate caution in the interpretation of 
results of the study., 

A second limitation of the study is concerned with the judgment procedures used to establish 
awociative response categories. Associative responses were grouped into response categories by only 
three judges. Although Ihe method itsdf required full agreement among judges at critical points and 
the judgment tasks were not considered difficult, the small number of judges did not permit adequate 
a88e€6fv>ent of their jiid^n^nt ability. The time required to categorize response words is also a factor 
to be cooeidered. Judges required from 6 to 10 hours each to categorize associative responses which 
was not considered burdensome. However, the time required to categorize word association data 
wtti increase as a function of the number of responses to be categorized. This, in turn, is a function 
©f the tota< number of stimuli, the time that subjects are allowed to free associate, and the number 
©f subjects in the experiment. Thus, the present method for categorization requires substantial 
amounts of time, v^ich under some circumstances may be prohibitive. 

Finally, it should be noted here that the present study included one unique procedure which 
would not be repeated in future investigations. The investigators found it difficult to transform 
each sin§le stimulus word into a representative phrase form of stimulus. It was often necessary to 
re-examine the literature from which each single stimulus word was selected in order to determine 
the conceptual area that each phrase was to represent. The single word in isolation often failed to 
dearly delimit a portion of the work environment. In any future application of the present method 
which might require new work categories or where new lists of phrases must be derived for categories 
within a non-work environment, each phrase would be directly derived from literature describing the 
respective category. The intermediate step of first deriving single words would not be required. 
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Conclusions 



It was concluded that the word association paradignn, using the methods described in Experi- 
ment II, was an effective technique to investigate both the content and structure of psychological 
meaning, especially the affective meaning of the work environment. In the present investigation the 
technique first elicited word associations to work-relevant phrases and then separated these associa- 
tions into 13 response categories. These categories provideri fcr a relatively detailed outline and de- 
scriptive summary of the subjects' occupational-specific effective struciures. !n addition, it was pos- 
sible to draw rich and meaningful comparisons between the three different occupations. 

It was also concluded that the me^'hod used fcr dimensional analysis had certain advantages. 
In the present investigation associative recoonst *vord categories were not a priori categories. Rather, 
they were a function of the associative responses themselves. Moreover, the meaning, and therefore 
the category assignment of each response word, ytta^ determineii in the context of its eliciting stim- 
ulus phrase, thereby accounting for any contextual ir.sj^ning-shift that might occur when the same 
associative response was given to different stimuli. 

Interpretation of the data was not difficult since the meaning of each response was readily de- 
rivea in the context of each stimulus phrase. This indicated that a high level of expertise should not 
be required to interpret data collected by use of this methodology. Too, the methodology did not 
violate certain ethical concerns regarding invasion of privacy since specificity of the phrase-form con- 
cepts insured t^at only affect relevant to a particular environment was identified and assessed, and 
the subject was fully aware of the purpose of the conceptual phrases used. Also certain phrases used 
in the present investigation (e.g., "opportunities for self-fulfillment") insured that the workers could 
indicate the affect associated with their perceptions of opportunities for occupational self-develop- 
ment. 

Perhaps the most important conclusion drawn from these exploratory efforts was that the pre- 
sent methodology was a technique with potential application to both the work environment and the 
classroom. That is, it was a highly flexible methodology. In regard to the work environment, the 
present list of work-related stimulus phrases was used to reveal common affective and cognitive vari- 
ables for three different occupational settings: the automotive, secretarial, and computer data pro- 
cessing work environments. Moreover, the present work-related instrument could easily be expanded. 
Additional categories of words could be included (e.g., phrases concerning Communication ) or pre- 
sent categories could be supplemented by additional work-related phrases to facilitate more detailed 
investigations of meaning in the work environment. 

Flexibility is further evident in this method in that it could easily be adapted to the learning en- 
vironment. The particular stimulus phrases, instructions, and examples given to subjects determine 
the desired associative response domain. Thus, the career educator, for example, might investigate 
the affective and related cognitive aspects of the learning situation, including the classroom and re- 
lated areas of the educational environment, by developing lists of classroom/learning-related phrases 
representative of the educational environment. 



Recommendations 

The present methodology can be used in various ways to identify affective variables character- 
istic of an environmental setting, or subsequently to derive a more refined assessment instrument 



As noted in Chapter I, it cannot be used directly to establish affective objectives. In the final analy- 
sis, the career educator or curriculum developer must place empirical knowledge of work-related 
affect in a coherent theoretical framework that accounts for the positive or negative affect that 
emerges from person-environment interaction, and he must translate that information into affective 
learning objectives. The recommendations that follow are therefore primarily concerned with the 
problem of accurate assessment of affect and related cognition within a particular environmental 
setting: 

1) The word association instiument and procedures described herein would 
be particularly helpful in systematically identifying the range of affect 
associated with the wor\ environment. This could aid the educator in 
understanding what aftect-related problems exist in the students poten- 
tial work environment. The flexibility of this methodology suggests 
also that educators could easily adapt it to assess affect within the edu- 
cational environment. 

2) Since the responses elicited under this format were predominantly value- 
laden, this technique would be particularly uieful in articulating differences 
between groups separated by, for example, di^'erent levels of satisfaction or 
dissatisfaction with the job or an educational jjrogram. This technique would 
also explicate detailed s!'''>ilarities and di^ Terences in affect between groups 
of students who exhibit 'successful and unsuccessful academic performance 
or between groups or workers who are considered satisfactory or unsatis- 
factory in job performance. 

3) The present methodology could be used to track, or follow, developmental 
changes in affect. The word association technique has already been used 
successfully in tracking cognitive development in the classroom (Johnson, 
P., 1967), The present technique could be used to periodically assess 
changes in affect that have been identified previously as relevant through- 
out a course of instruction. Similarly, changes in affect that might occur 
between job entry and successful personal and interpersonal adjustment 
could be followed. 

4) The clear structural dimensions of affect revealed in the content analysis 
of each occupation suggest that those dimensions could be used to con- 
struct comprehensive questions for determining the pattern of affective 
variables across each ot the occupational groups. This instrument sub- 
sequently could be administered to larger, more adequate samples of 
workers in the three occupations. Results of this effort would more 
closely approximate a comprehensive assessment of work-related affect. 
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APPENDIX A 

A-1 Experiment I: Word Association Data Collection Instrument, Single Word Format 

A-2 Experiment I: Response Distribution Pooled by Stimulus Word and Frequency 

A-3 Experiment I: On Single-Word vs. Sentence-Stem Format and the Use of Adjective Stimuli. 
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APPENDIX A-1 

Experiment I:; Word Association Data Collection Instrument, Single Word Format. 
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INSTRUCTIONS FOR USE BY ADMINISTRATORS 



Pass out the response booklets ano pencils. 

Hello, my name is [ ] , and I am f'^om The Center for Vocational Educa- 

tion at The Ohio State University For those of you not familiar with The Center, it is a group of 
educational researchers. One of our major functions is the development and refinement of vocation- 
al and technical training programs. The procedure which we are administering today is part of a re- 
search program. This is a word association procedure and we are testing it for use in the area of cur- 
riculum development. 

One of the vocational programs we are concerned with is the training of [ ]. 
This is why we have asked you especially to help us. 

The first thing we would like yoii to do is to fill out the Background Information sheets that 
are attached to the booklets in front of you. Be assured that all the information requested will be 
held in confidence and that your name will not be used in any way. 

Back ound. Information sheets filled out., 

if all of you have now finished filling out the Background Information sheets will you please 
give me your attention and I will now read the general instructions that you will follow in complet- 
ing this questionnaire. Please stop me any time you have a question. 

The following pages contain 105 words that are designed to find out what work means to peo- 
ple, and how they think and fee! about their work. This questionnaire is intended to identify the 
many ways people think about work. It does not evaluate your performance as an employee.. The 
results will be used for research only and, therefore, we t.^st that you will do your best to provide 
the necessary information. For each word you are asked to write down as many other words as you 
can think of in a short period of time. 

On each page a key word representing an idea relating to work is printed 15 times. Open your 
booklets to about the middle page and you can see how this looks. Each repetition is followed by a 
blank space. You are to write in the blank spaces as many different words that the key word makes 
you think of.. Each response should consist of only one word. Many of the key words are related to 
work, that is, they refer to work and will always make you think of your job. The word "supervisor" 
is an example. Other words, 'jl^h as "experience," are not necessarily related to work. H'^wever, 
you are to consider all of the key words as if they were related to your work. That way your response 
will identify the meaning each key word has in reference to your work situation. Be sure to think back 
to the key word after each word that you write because the point is to see how many and what other 
words the Key words make you think of.. 
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You will have 45 seconds to write as many words as you can think of which are related to the 
key word on each page. When a recorded tone sounds, begin writing responses to the key words on 
the first paqe. Each time the tone sounds, turn the page and begin writing words to the key word on 
the next page. Do not turn the page uniil the tone sounds. You will continue the procedure for 40 
minutes and then there will be a itop for a short rest Write as fast and as clearly as you can, but do 
not be too concerned about the proper spelling of the words. There are no right or wrong answers. 
You will have a chance to practice on a few words before we begin. 

If you will now turn to the first page of your booklet you can see a completed example of the 
type of words you will encounter. It shows you the procedure you should follow. The word is 
''task," and it is repeated 15 times on a single page. I will go over the example with you. 

in the spaces provided someone has written different words that came to their mind as they 
looked at the key word. All of their responses are different; they are single words and the person 
was presumably thinking about their work as they wrote. Therefore, they dire appropriate responses. 

Please note the richness of meaning that this person has given the word "task." They have de- 
scribed a task as an assignment; they see a task as work, but as a smaW part of their job; to them a 
task requires that they perform in some way; and finally they see a task as easy but boring. Some 
of these responses describe the key word. Some may indicate the job action implied by the key 
word. And some responses indicate feelings in relation to the concept identified by the key word. 

To continue now, at the bonom of the page, it says that it is not necessary for you to fill in all 
15 blanks or to try to write as many different kinds of responses for each key word as the person 
did to the key word "task." However, you should try to write all those responses that will best tell 
what the key word means to you in relation to your work situation. 

Are there any questions? Before we start, I would like to remind you to always tnink back to 
the key word after each word that you write because the point is to see how many and what other 
kinds of words the key word makes you think of. Also you should try to write al! of those responses 
that will best tell what the key word means to you and how it makes you feel in relation to work. 
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WORD ASSOCIATION 
RESPONSE BOOKLET 



The Center for Vocational Education 
The Ohio State University 

1960 Kenny Road 
Columbus, Ohio 43210 
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BACKGROUND INFOftMATlON 



NAME 



CODE 



CHECK YOUR AGE 
(IN YEARS) 



Less than 21 21-25 26-30 31-3& 36-40 
(){)()()() 



CHECK YOUR PRESENT JOB TITLE: 
Receptionist ( ) 
Typist ( ) 
Executive Secretary ( ) 
Other (Please specify) 



Stenographer ( ) 
General Secretary ( ) 

Administrative Assistant 



41-45 46ornr)ore 
( ) ( ) 



Legal Secretary ( ) 
Medical Secretary ( ) 
( ) 



HOW MANY YEARS HAVE YOU WORKED FULL TIME AT YOUR PRESENT JOB^ 



HOW MANY TOTAL YEARS HAVE YOU BEEN EMPLOYED FULL-TIME IN THIS OCCUPATION? 



EDUCATION: 

1. High School: Graduated from hi^ school (or equivalent): Yp$_ 



No 



Z Vocational training (check one response 
for each typ>e of training):. 



a. Vocational -technical in h»gh school 

b. Vo nional techrVcal post-hi^h school 
c Junior or community colle«ae 

d. Four-year collc^ '\ ^.r* fersity 

e. M. .{ary technical tramirg school 
f- Business school or business colfege 
g Formal company tramtng program 

h Formal trade apprenticeship program 

i. On the job experience 

j Other (specify) 



Years of AtterKlarKe 



None 



Less 
Than 
1 



S 
or 



3. After marking all of the above in question 2, ilso please circle ont of the letters below indicating the one 
training situation where you learned most o' your job skills (other than on the job experience). 



a b c d e f 

ThanK you for your cooperation in completing th's questionnaire. 
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BACKGROUND INFORMATION 



NAME 

CHECK YOUR AGE Less than 21 
(IN YEARS)- ( ) 

CHECK YOUR PRESENT JOB TITLE: 

Data Converting Operator ( ) 

Computer Console C'perator ( ) 

Junior Programmer ( ) 

Other (please specify) 



21-25 26-30 31-35 
( ) ( ) ( ) 

Programmer ( ) 

Lead Programmer ( ) 
Senior Programmer ( ) 



Than 
None 1 



CODE 



36-40 41-45 46 or more 
( ) ( ) ( ) 



Systems & Procedures 

Analyst ( ) 

Systems Programmer ( ) 



5 
or 

1 2 3 4 More 



HOW WANY YEARS HAVE YOU WORKED FULL-TIME AT YOUR PRESENT JOB? 



HOW MANY TOTAL YEARS HAVE YOU BEEN EMPLOYED FULL-TIME IN THIS OCCUPATION? 



EDUCATION. 

1. High School: Graduated from high school (or equivalent): Yes 



No 



2. Vocational training (check one response 
for each type of training)- 



Years of Attendance 



Less 



a. Vocational-technical m high school 

b. Vocational-technical post-high school 

c. Junior or community college 

d. Four-year college o* university __ 

e. Military technical training school __ 

f- Business school or business college 

q. Formal company tramtng program 

h. Formal Trade dpprsniicoship program __ - 

\. On the job experience 

J. Other (specify) 

3 After marking all of the above in question 2, also please circle one of the letters below indicating the one 

training situation where you learned most of your job <;kills (other than on the job experience*). 

a b c d e f 9 h i j 
Thank you for your cooperation in completing this questionnaire 
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BACKGROUND INFORMATION 



NAMf 



CODE 



CHECK YOUR AGE Less than 21 21-25 26-30 31 35 36 40 4145 46 or more 
(IN YEARS) ()()()()()()() 



CHECK YOUR PRESENT JOB TITLE: 
Automotive Mechanic Apprentice ( ) 
Automotive Mechanic ( ) 
Other (please specify)* 



Service Advisor or Writer ( ) 
Job Specialist ( ) 



HOW MANY YEARS HAVE YOU WORKED FULL-TIME AT YOUR PRESENT JOB^ 



HOW MANY TOTAL YEARS HAVE YOU BEEN EMPLOYED FULLTIME IN THIS OCCUPATION? 



EDUCATION- 

1. High School Graduated from high school (or equivalent)' Yes__ 



No 



2. Vocational training (check one response 
for each type of training)* 



a. Vocational-technical lo high school 

b. Vocational techniC;*^ post high school 

c. Jun.'^r or community co'tege 

<i Four vear college or university 

e. Military technical tra«riing school 

f B'-j^mpss srhoo* or biisin»?s? college 

g. Formal compony tramtng program 

h. Forma' trade* apprenticeship program 
I., On :he job «>xperience 

j. Orhe' (sp'iCiS) 



Years of Attendance 



None 



Less 
Than 
1 



5 
or 
More 



3 Aftr ' marking all of the above m question 2, also please circle one of the letters below indicating the one 
traming situatior< where vou learned most of your job skills (other than on the job experience) 



9 



Thank you for yojr cooperation m completing this questionpaire. 
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DIRECTIONS 



In the spaces provided someone has written different words that came to their mind as they 
looked at the key word. All of their responses are different; they are single words, and they were 
presumably thinking about their work as they wrote. Therefore, they are appropriate responses. 

task 

task jtJlMj^ 

task 

task jLrU^h^ 

task .^j^^JL^ 

task -'''^LJIa^^^ 

task ^ 

task 

task 

task 

task 
task 

task 

task ^ 

task 



It is not necessary for you to fill in all 15 blanks or to try to write as many different kinds of 
responses for each key word as the person did to the key word "task./' However, you should try to 
write all those responses that will best tell what the key word means to you in relation to your work 
situation. 
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SAMPLE SHEET 



absenteeism 
absenteeism 
absenteeism 
absenteeism 
absenteeism 
absenteeism 
absenteeism 
absenteeism 
absenteeis.T) 
absenteeism 
absenteeism 
absenteeism 
absenteeism 
absenteeism 
absenteeism 
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SAMPLE SHEET 



assignment 
assignment 
assignment 
assignment 
assignment 
assignment 
assignment 
assignment 
assignment 
assignment 
assignment 
assignment 
assignment 
assignment 
assignment 
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APPENDIX A-2 

Experiment I: Pooled Response Distribution, by Stimulus Word and Frequency 
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Experiment I: Ofi u<ngle-Word vs. Sentence-Stem Format and the Use of Adjective Stimu 
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Experiment I: On Single-Word vs. Sentence-Stem Format 
and the Use of Adjective Stimu!» 



Problem 

In additiof^ to the primary research questions posed for these investigations, certain methodolo- 
gical questions were investigated concerning the effects of different formats of stimulus presentation 
and of stimuli consisting of different parts of speech. 



Stimulus Format 

The stimulus format used in a word association task has been found to influence, or restrict, 
the semantic level of response. For example, Nunnally and his associates (Nunnally, Flaugher & 
Hodges, 1963; Nunnally & Hodges, 1965) indicated that the format of the word association instru- 
ment itself will alter the semantic range of responses. Nunnally reported that a sentence-completion 
format induced subjects to give a high percentage of certain paradigmatic responses; for example, 
those that are descriptive. This suggests that a sentence-completion format will elicit a higher per- 
centage of affective responses when compared with responses elicited by the more traditional single- 
word stimulus. However, Nunnally used only the sentence-completion format and did not, therefore, 
make the comparison. In the present investigation, both single-word and sentence-completion for- 
mats were used in an attempt to determine whether the sentence-completion format, when compared 
to the single-word format, would elicit responses judged higher in affective content. 

Adjective Stimuli 

In Chapter 1 1 1 of this document it was assumed that the instructions given to subjects would es- 
tablish a work-related context or "set." Giv en th e assumption that each adjective stimulus would 
elicit responses which represent different physical and abstract aspects of the work environment," 
then a relatively easy match could be made between level of affect (as defined by the adjective stim- 
ulus) and aspects of the work environment (as defined by associative responses). Subsequently, such 
a match could be compared with responses given to the noun form of each stimulus to determine 
which form best outlines the affective and other psychological meaning chdracteristic of the work 
environment. 



Method 

Data was collected using the material and procedures described in Chapter III. Data analyses 
appropriate to test the hypothesis concerning the format of the stimuli and to determine the 
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efficiency cf adjective stimuli to elicit associative responses that name aspects of the work environ- 
ment are reported below along with the results of those analyses. 



Results 

Affective Level of Responses 

To determine which format elicited responses with the highest level of affective content, the 
following analyses were completed. Subjects' responses were pooled across occupations for the 10 
subjects, and a random sample of 14 sentence-stems (and their respective responses) were selecied 
along with the 14 single-word equivalents (and their respective responses). Fourteen judges then 
rated each of the pooled responses in the context of the appropriate stimulus word or sentence-stem. 
Ratings were made on a nine-interval, "extiemely unfavorable" to "extremely favorable." scale. 
Each judge then received an average score for his rating of all responses given to all sentence-stems. 
Identical interratjr reliability scores (each score adjusted for mean differences) of .93 were obtained 
for judges or bolh the single-word and the sentence-stem formats. 

A mean deviation score (using the fifth interval of the nine interval scale as a neutral point) was 
also computed for each judge's ratings and a repeated-measures analysis of variance was performed. 
The results were marginally significant (p<.06) and a subsequent t-test for related-measures was sig- 
nificant (p<.05). It was tentatively concluded that a sentence-stem format could be expected to 
elicit responses judged higher in affective content when compared to responses given to single-word 
stimuli. 



Adjective Stimuli 

As indicated in Chapter 1 1 1, the assumption that instructions to subjects would establish a work- 
related set were supported. In Experiment I, more than 50% of th« stimulus words elicited the re- 
sponses 'work" or "job." Therefore, it was deemed appropriate to examine the hypothesis that 
stimuli in the adjective form would elicit a significant proportion of responses in the noun form, 
which would represent aspects of the work environment. If true, this in turn would facilitate an 
affect-environmental object match between stimulus word and associative response that would =9 
meaningful, especially when the subjects sampled were representative of workers in a particular oc- 
cupation. The following analyses were completed. 

First, the pooled responses given by subjects to the 16 adjectives in the single-word format were 
compared to the puoled responses given to 16 randomly selected noun stimuli from the remaining 
84 stimuli in the single-word format. Two judges determined (with 100% agreement required) the 
proportion of responses that represented aspects of the work environment. Judges were told to view 
the stimulus words within each of the seven work categories as representative examples of aspects of 
the work environment and to judge the subjects' responses in that context. The percentage of work- 
related responses averaged 12% for the 16 adjective stimuli and 35% for the 16 noun stimuli. A test 
for difference between two proportions indicated that a significantly higher proportion of work-re- 
lated responses were given to the noun stimuli (n.<.01). 
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The responses to the stimulus word "good" that were judged to be work-related are presented 
below. Almost all responses to "good" could be classified . s generally ^ esirable aspects of any work 

RESPONSE DISTRIBUTION 
FOR STIMULUS WORD "GOOD" 



Good 


f 


work 


4 


job 


3 


pay 


2 


tool 


2 


ability 


2 


training 


2 


lighting 


2 


benefit 




security 




promotion 




rating 




boss 




ring 




raise 




task 




knowledge 




effective 




efficient 





environment and it was difficult to infer the attitude of the subjects sampled toward aspects of their 
work environment. Also, the psychological meaning inherent in the distribution was very narrow 
and a function of the stimulus word itself. The adjective stimulus had served simply to classify appro- 
priate aspects of the environment un^er the category "good." Therefore, while an affect-environmen- 
tal match may be possible, the range of affective psychological meaning that could be assigned to the 
associative responses representing aspects of the work environment was limited to the affective dimen- 
sions found in adjectives, adverbs, and, perhaps, worker attributes. 

Osgood (1969) indicated that there are probably only three (evaluation, potency and activity) 
affective dimensions of meaning within adjectives, adverbs and other words which serve to modify 
and describe stimulus objects. Futhermore, Osgood, Suci and Tannenbaum (1957) have shown that 
the semantic differential technique is a well-established and more rigorous technique than has been 
developed in the present study for using modifiers to index affective dimensions of meaning. Finally, 
the responses "work" and "job," ^ described in Chapter III, are considered ambiguous, especially so 
in the present format. 

The adjective form of the stimuli elicited significantly fewer work-related responses, functioned 
to sharply restrict the word association paradigm to an investigation of the affective dimensions of 
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meanings (an endeavor best accomplished by the semantic differential technique), aid, in the present 
context, elicited work-related responses that were artifacts of the response set 



Summary 

Briefly, the sentence-stem format was found to elicit responses judged higher in affect when 
compared to the single-word format. Also, the noun form of the stinnuli was judged to be more 
appropriate for the investigation of psychological meaning than the adjective form. 
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APPENDIX B 



B-1 Experiment II: Word Association Data Collection Instrument, Stimulus Phrase Format 

B-2 Experiment II:: Response Distributions Pooied by Stimulus Phrase and Frequency 

B-3 Experiment il: Automotive Mechanics' Response Distribution, by Stimulus Phrase and 
Frequency 

B-4 Experiment II: Computer Data Processors' Response Distribution, by Stimulus Phrase and 
Frequency 

S-5 Experiment II: Secretaries' Response Distribution, by Stimulus Phrase and Frequency 
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APHENDIX B-1 

Experiment II: Word Association Data Collection Instrument, Stimulus Phrase Format 
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INSTRUCTIONS FOR USE BY ADMINISTRATORS 



Pass out the nesponse booklets and pencils. 

Hello, my name is [ and I am from The Center for Vocational Educa- 

tion at The Ohio State University. In case you don't know, it is a group of educational researchers- 
One of our major functioi^ is the development and refinment of vocational and technical training 
programs. You will be participatir^ today in part of one of our research programs. 

One of the vocational programs we are concerned with is the training of ( J . 

This is why we have asked you especially to help us. 

The first thing we would like you to do is to fill out the Background Information srieets that 
are attached to the booklets in front of you. We are only interested in group results, not those of 
any individual. Be assured that all the information requested will be held in confidence and that 
your name will not be used in any way. 



Background Information sheets filled out 

Is anyone still filling out a Background Information sheet? Your booklets contain severe! dif- 
ferent tasks. Now ni read the general instructions that you are to follow in completing the first 
task. Feel free to stop me any time you have a question. 

The following pages contain 40 diffe.^nt concepts that are designed to find out what work 
means to people, and how they think and feel about their work. This questionnaire is intended to 
'^tify the many ways people think about woi k. It does not evaluate your performance as an em- 
ployee. The result; will be used at the OSU Center for Vocational Education tor research purpose 
only. Therefore, we hope that you will do yourvery best to provide the Information we need. For 
each concept you are asked to write down as many other words as you can think of in a short period 
of time. 

On each page a key concept representing an idea relating to work is printed 15 times. Open 
your booklets to about Pages 5 or 6, and you can see how this looks. Each repetition is followed 
by a blank space. You are to write in the bloik spaces as many different words that the key concept 
makes you think of. Each response should consist of only one word. Be sure to think back to the 
key concept after each word that you write because the point is to see now many and what other 
words the key concept makes you think of. 

You will have 35 seconds to write as many words as you can think of which are related to the 
key concept on each page. When a recorded tone sounds, begin writing responses to the key words 
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on the first page. Each tinne the tone sounds turn the and begin writing words to the key word 
on the next page. Do not turn the page until the tone sounds. You will follow this procedure for 
25 minutes and then there will be a stop for a short rest. Write as fast and as clearly as you can, but 
not be too concerned about the proper spelling of the weds. There are not right or wrong answers. 
You will have a chance to practice on a few words before ve begin. 

if you will now turn to the first page of your booklet, you can see a completed example of the 
type of words you will encounter. It shows you the procedure you should follow. The concept is 
''job knowledge/' and it is repeated 1 5 times on a single page. 

You can see that in the spaces provided, someone has written different words that came to 
their mind as they looked at the key concept Ail of their responses are different and they are single 
words. Therefore, they are ^propriate responses. 

Please note the richness of meaning that this person has given the concept "job knowledge/' 
They indicated that it is related to experience, skill and ability, that it is necessary; that it involves 
training, that it is helpful and related to performance. Some of these responses describe the key 
concept. Some may indicate the job action implied by the key concept. And some responses indi- 
cate feelings in relation to the concept. 

Note that, at the bottom of the page, it says that it is not necessary for you to fill in all 15 
blanks or to try to write as many different kinds of responses for each concept as you see in the 
example. However, you should try to write all of the responses that will best tell what the key 
concept means to you in relation to your work situation. 

Are there any questions? Before we start, I would like to remind you to think back to the key 
concept after each word you write, because the point is to see how many and what other kinds of 
words the key concept makes you think of 
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WORD ASSOCIATION 
RESPONSE BOOKLET 



The Center for Vocational Education 
The Ohio State University 
1960 Kenny Road 
Columbus, Ohio 43210 



lit 



BACKGROUND INFORMATION 



NAME 



CODE 



ERIC 



CHECK YOUR AGE 
(IN YEARS) 



Less than 21 21-25 26-30 31-35 36-40 
( ) ( ) I ) I ) ( ) 



CHECK YOUR PRESENT JOB TITLE: 
Receptionist ( ) 
Typist ( ) 

Executive Secretary ( ) 
Other (please specify): 



Stenographer ( ) 
General Secretary ( ) 

Administrative Assistant 



41-45 46 or more 
( ) ( ) 



Legal Secretary ( ) 
Medical Secretary ( ) 
( ) 



HOW MANY YEARS HAVE YOU WORKED FULL TIME AT YOUR PRESENT JOB? 



HOW MANY TOTAL YEARS HAVE YOU BEEN EMPLOYED FULL TIME IN THIS OCCUPATION? 
EDUCATION: 

1. High School: Graduated from high school (or equivalent): Yes No 



2. Vocational training (check one response 
for each type of training) :; 



a. Vocational-technical in high school 

b. Vocational-technical post-high school 
c Junior or community college 

d. Four-year college or university 

c. Military technical training school 

f. Business school or business college 

g. Formal company training program 

h. Formal trade apprenticeship program 

i. On the job experience 

J. Other (specify)^ 



Years of Attendance 



None 



Less 
Than 
1 



5 
or 
More 



3. After marking all of the above in question 2, also please circle one of the letters below indicating the one 
training situation where you learned most of your job skiiis (other than on the job experience). 



a b c d e f 
Thank you for your cooperation in completing this questionnaire., 
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BACKGROUND INFORMATION 



NAME 



CODE 



CHECK YOUR AGE 
(IN YEARS): 



Less than 21 21-25 26-30 31-35 36-40 
()<)()()<) 



41-45 46 or more 
( ) ( ) 



CHECK YOUR PRESENT JOB TITLE:- 
Data Converting Operator ( ) 
Computer Console Operator ( ) 
Junior Programmer ( ) 

Other (please specify): 



Programmer ( ) Systems & Procedures Analyst ( 

Lead Programmer < ) Systems Programmer ( 
Senior Programmer ( ) 



HOW MANY YEARS HAVE YOU WORKED FULL-TIME AT YOUR PRESENT JOB? 



HOW MANY TOTAL YEARS HAVE YOU BEEN EMPLOYED FULL-TIME IN THIS OCCUPATION? 
EDUCATION. 

1. High School* Graduated from high school (or equivalent):: Yes No 



2. Vocational training (check one response 
for each type of training): 



a. . Vocational-technical in high school 

b. . Vocational-technical post-high school 
c Junior or community college 

d. Four-year college or university 

e. Military technical training school 

f. Business school or business college 

g. Formal company training program 

h. . Formal trade apprenticeship program 
I. On the job experience 

\„ Other (specify) 



Years of Attendance 



None 



Less 
Than 
1 



or 
More 



3. After marking all of the above !n question 2, also please circle one of the letters below indicating the one 
training s.tuation where you learned most of your job skills (other than on the job experience). 

a b c d e f g h i j 

Thank you for your cooperation in completing this questionnaire.. 
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BACKGROUND INFORMATION 



NAME 



CODE 



CHECK YOUR AGE 
(IN YEARS): 



Less than 21 21-25 
(1(1 



CHECK YOUR PRESENT JOB TITLE. 

Automotive Mechanic Apprentice ( ) 
Automotive Mechanic ( | 

Other (please specify}: 



26-30 
( I 



31-35 
( I 



36-40 

( I 



41-45 
( ) 



Service Advisor or Writer ( | 
Job Specialist ( ) 



45 or more 
( I 



HOW MANY YEARS HAVE YOU WORKED FULL-TIME AT YOUR PRESENT JOB? 

HOW MANY TOTAL YEARS HAVE YOU BEEN EMPLOYED FULL-TIME IN THIS OCCUPATION^ 
EDUCATION: 

1. High School:. Graduated from high school (or equivalent}: Yes No 



2. Vocational training (check one response Years of Attendance 



for each type of training} 


Less 
Than 

None 1 1 2 


5 
or 

3 4 More 


a. Vocational-technical in high school 






b. Vocational-technical post-high school 






c Junior or community college 






d. Four-year college or university 






c. Military technical training school 






f Business school or business college 






g. Formal company training program 






h. Formal trade apprenticeship program 






1 On the )ob experience 






j. Other (specify} 











3. After marking all of the above in question 2, also please circle one of the letters below indicating the one 
training situation where you learned most of your )ob skills (other than on the job experience}. 

abcdef ghi j 

Thank you for your cooperation in completing this questionnaire. 
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DIRECTIONS 



In the spaces provided someone has written different words that came to their mind as they 
looked at the key concept. All of their responses are different; they are single words, and they were 
presumably thinking about their work as they wrote. Therefore, they are appropriate responses. 



job knowledge ./^J^AAJU^I/j 



job knowledge 
job knowledge 
job knowledge 
job knowledge 
job knowledge 



job knowledge 
job knowledge 
job knowledge 
job knowledge 
job knowledge 
job knowledge 
job knowledge 



A. 




job knowledge -"JuA. ^A^Mid^^KJU 

job knowledge 



It is not necessary for you to fill in all 15 blanks or to try to write as many different kinds of 
responses for each key concept as the person did to "job knowledge." However, you should try to 
write all those responses that will best tell what the key concept means to you in relation to your 
work situation. 
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SAMPLE SHEET 



my job 
my job 
my job 
my job 
my job 
my job 
my job 
my job 
my job 
my job 
my job 
my job 
my job 
my job 
my job 
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APPENDIX B-2 

Experiment 1 1 : Response Distributions Pooled 
by Stimulus Phrase and Frequency 
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APPENDIX B-3 

Experiment II: Automotive Mechanics' Response Distribution, 
by Stimulus Phrase and Frequency 
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APPENDIX B-4 

Experiment II: Computer Data Processors' Response Distribution, 
by Stimulus Phrase and Frequency 
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Experiment II: Secretaries' Response Distribution, 
by Stimulus Phrase and Frequency 
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